Nov 03 13:42:39 user nova-compute[74582]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74582) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74582) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74582) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 13:42:39 user nova-compute[74582]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:42:39 user nova-compute[74582]: INFO nova.virt.driver [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 03 13:42:39 user nova-compute[74582]: INFO nova.compute.provider_config [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Acquiring lock "singleton_lock" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Acquired lock "singleton_lock" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Releasing lock "singleton_lock" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Full set of CONF: {{(pid=74582) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ******************************************************************************** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Configuration options gathered from: {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ================================================================================ {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] allow_resize_to_same_host      = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] arq_binding_timeout            = 300 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] backdoor_port                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] backdoor_socket                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] block_device_allocate_retries  = 300 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] block_device_allocate_retries_interval = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cert                           = self.pem {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute_monitors               = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] config_dir                     = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] config_drive_format            = iso9660 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] config_source                  = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] console_host                   = user {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] control_exchange               = nova {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cpu_allocation_ratio           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] daemon                         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] debug                          = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] default_access_ip_network_name = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] default_availability_zone      = nova {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] default_ephemeral_format       = ext4 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] default_green_pool_size        = 1000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] default_schedule_zone          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] disk_allocation_ratio          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] enable_new_services            = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] enabled_ssl_apis               = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] flat_injected                  = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] force_config_drive             = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] force_raw_images               = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] graceful_shutdown_timeout      = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] heal_instance_info_cache_interval = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] host                           = user {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_build_timeout         = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_delete_interval       = 300 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_name_template         = instance-%08x {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_usage_audit           = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_usage_audit_period    = month {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] internal_service_availability_zone = internal {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] key                            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] live_migration_retry_count     = 30 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_config_append              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_dir                        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_file                       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_options                    = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_rotate_interval            = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_rotate_interval_type       = days {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] log_rotation_type              = none {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] long_rpc_timeout               = 1800 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] max_concurrent_builds          = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] max_concurrent_live_migrations = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] max_concurrent_snapshots       = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] max_local_block_devices        = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] max_logfile_count              = 30 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] max_logfile_size_mb            = 200 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] maximum_instance_delete_attempts = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metadata_listen                = 0.0.0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metadata_listen_port           = 8775 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metadata_workers               = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] migrate_max_retries            = -1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] mkisofs_cmd                    = genisoimage {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] my_ip                          = 10.0.0.210 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] network_allocate_retries       = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] osapi_compute_listen_port      = 8774 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] osapi_compute_unique_server_name_scope =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] osapi_compute_workers          = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] password_length                = 12 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] periodic_enable                = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] periodic_fuzzy_delay           = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] pointer_model                  = ps2mouse {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] preallocate_images             = none {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] publish_errors                 = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] pybasedir                      = /opt/stack/nova {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ram_allocation_ratio           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rate_limit_burst               = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rate_limit_except_level        = CRITICAL {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rate_limit_interval            = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reboot_timeout                 = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reclaim_instance_interval      = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] record                         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reimage_timeout_per_gb         = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] report_interval                = 120 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rescue_timeout                 = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reserved_host_cpus             = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reserved_host_disk_mb          = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reserved_host_memory_mb        = 512 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] reserved_huge_pages            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] resize_confirm_window          = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] resize_fs_using_block_device   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] resume_guests_state_on_host_boot = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rpc_response_timeout           = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] run_external_periodic_tasks    = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] running_deleted_instance_action = reap {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] running_deleted_instance_timeout = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler_instance_sync_interval = 120 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_down_time              = 720 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] servicegroup_driver            = db {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] shelved_offload_time           = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] shelved_poll_interval          = 3600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] shutdown_timeout               = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] source_is_ipv6                 = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ssl_only                       = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] state_path                     = /opt/stack/data/nova {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] sync_power_state_interval      = 600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] sync_power_state_pool_size     = 1000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] syslog_log_facility            = LOG_USER {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] tempdir                        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] timeout_nbd                    = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] transport_url                  = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] update_resources_interval      = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_cow_images                 = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_eventlog                   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_journal                    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_json                       = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_rootwrap_daemon            = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_stderr                     = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] use_syslog                     = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vcpu_pin_set                   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plugging_is_fatal          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plugging_timeout           = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] virt_mkfs                      = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] volume_usage_poll_interval     = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] watch_log_file                 = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] web                            = /usr/share/spice-html5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.auth_strategy              = keystone {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.compute_link_prefix        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.dhcp_domain                = novalocal {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.enable_instance_password   = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.glance_link_prefix         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.instance_list_per_project_cells = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.list_records_by_skipping_down_cells = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.local_metadata_per_cell    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.max_limit                  = 1000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.metadata_cache_expiration  = 15 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.neutron_default_tenant_id  = default {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.use_forwarded_for          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.use_neutron_default_nets   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_dynamic_targets = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_jsonfile_path   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.backend_argument         = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.config_prefix            = cache.oslo {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.dead_timeout             = 60.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.debug_cache_backend      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.enable_retry_client      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.enable_socket_keepalive  = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.enabled                  = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.expiration_time          = 600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_dead_retry      = 300 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_password        =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_sasl_enabled    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.memcache_username        =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.proxies                  = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.retry_attempts           = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.retry_delay              = 0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.socket_keepalive_count   = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.socket_keepalive_idle    = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.socket_keepalive_interval = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.tls_allowed_ciphers      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.tls_cafile               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.tls_certfile             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.tls_enabled              = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cache.tls_keyfile              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.auth_section            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.auth_type               = password {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.cafile                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.certfile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.collect_timing          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.cross_az_attach         = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.debug                   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.endpoint_template       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.http_retries            = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.insecure                = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.keyfile                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.os_region_name          = RegionOne {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.split_loggers           = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cinder.timeout                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.cpu_dedicated_set      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.cpu_shared_set         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.image_type_exclude_list = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.resource_provider_association_refresh = 300 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.shutdown_retry_interval = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] conductor.workers              = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] console.allowed_origins        = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] console.ssl_ciphers            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] console.ssl_minimum_version    = default {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] consoleauth.token_ttl          = 600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.cafile                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.certfile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.collect_timing          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.connect_retries         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.connect_retry_delay     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.endpoint_override       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.insecure                = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.keyfile                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.max_version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.min_version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.region_name             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.service_name            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.service_type            = accelerator {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.split_loggers           = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.status_code_retries     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.timeout                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] cyborg.version                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.backend               = sqlalchemy {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.connection            = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.connection_debug      = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.connection_parameters =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.connection_recycle_time = 3600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.connection_trace      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.db_inc_retry_interval = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.db_max_retries        = 20 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.db_max_retry_interval = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.db_retry_interval     = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.max_overflow          = 50 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.max_pool_size         = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.max_retries           = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.pool_timeout          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.retry_interval        = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.slave_connection      = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] database.sqlite_synchronous    = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.backend           = sqlalchemy {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.connection        = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.connection_debug  = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.connection_parameters =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.connection_recycle_time = 3600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.connection_trace  = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.db_inc_retry_interval = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.db_max_retries    = 20 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.db_max_retry_interval = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.db_retry_interval = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.max_overflow      = 50 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.max_pool_size     = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.max_retries       = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.pool_timeout      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.retry_interval    = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.slave_connection  = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] api_database.sqlite_synchronous = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] devices.enabled_mdev_types     = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ephemeral_storage_encryption.enabled = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.api_servers             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.cafile                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.certfile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.collect_timing          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.connect_retries         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.connect_retry_delay     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.debug                   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.default_trusted_certificate_ids = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.enable_certificate_validation = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.enable_rbd_download     = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.endpoint_override       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.insecure                = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.keyfile                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.max_version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.min_version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.num_retries             = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.rbd_ceph_conf           =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.rbd_connect_timeout     = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.rbd_pool                =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.rbd_user                =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.region_name             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.service_name            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.service_type            = image {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.split_loggers           = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.status_code_retries     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.timeout                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.verify_glance_signatures = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] glance.version                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] guestfs.debug                  = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.config_drive_cdrom      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.config_drive_inject_password = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.enable_remotefx         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.instances_path_share    =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.limit_cpu_features      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.use_multipath_io        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.vswitch_name            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] mks.enabled                    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] image_cache.manager_interval   = 2400 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] image_cache.precache_concurrency = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] image_cache.remove_unused_base_images = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] image_cache.subdirectory_name  = _base {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.api_max_retries         = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.api_retry_interval      = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.auth_section            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.auth_type               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.cafile                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.certfile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.collect_timing          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.conductor_group         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.connect_retries         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.connect_retry_delay     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.endpoint_override       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.insecure                = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.keyfile                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.max_version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.min_version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.peer_list               = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.region_name             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.serial_console_state_timeout = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.service_name            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.service_type            = baremetal {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.split_loggers           = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.status_code_retries     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.timeout                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ironic.version                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] key_manager.fixed_key          = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.barbican_api_version  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.barbican_endpoint     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.barbican_endpoint_type = public {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.barbican_region_name  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.cafile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.certfile              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.collect_timing        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.insecure              = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.keyfile               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.number_of_retries     = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.retry_delay           = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.send_service_user_token = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.split_loggers         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.timeout               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.verify_ssl            = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican.verify_ssl_path       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.auth_section = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.auth_type = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.cafile   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.certfile = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.collect_timing = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.insecure = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.keyfile  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.split_loggers = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] barbican_service_user.timeout  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.approle_role_id          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.approle_secret_id        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.cafile                   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.certfile                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.collect_timing           = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.insecure                 = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.keyfile                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.kv_mountpoint            = secret {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.kv_path                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.kv_version               = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.namespace                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.root_token_id            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.split_loggers            = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.ssl_ca_crt_file          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.timeout                  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.use_ssl                  = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.auth_section          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.auth_type             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.cafile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.certfile              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.collect_timing        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.connect_retries       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.connect_retry_delay   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.endpoint_override     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.insecure              = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.keyfile               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.max_version           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.min_version           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.region_name           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.service_name          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.service_type          = identity {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.split_loggers         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.status_code_retries   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.timeout               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] keystone.version               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.connection_uri         =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_mode               = custom {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: WARNING oslo_config.cfg [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_power_governor_high = performance {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_power_management   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.device_detach_attempts = 8 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.device_detach_timeout  = 20 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.disk_cachemodes        = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.disk_prefix            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.enabled_perf_events    = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.file_backed_memory     = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.gid_maps               = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.hw_disk_discard        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.hw_machine_type        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_rbd_pool        = rbd {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_type            = default {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.images_volume_group    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.inject_key             = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.inject_partition       = -2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.inject_password        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.iscsi_iface            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.iser_use_multipath     = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_downtime = 500 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_inbound_addr = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_scheme  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_timeout_action = abort {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_tunnelled = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: WARNING oslo_config.cfg [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 03 13:42:39 user nova-compute[74582]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 03 13:42:39 user nova-compute[74582]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 03 13:42:39 user nova-compute[74582]: and ``live_migration_inbound_addr`` respectively.
Nov 03 13:42:39 user nova-compute[74582]: ).  Its value may be silently ignored in the future.
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.live_migration_with_native_tls = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.max_queues             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.nfs_mount_options      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.num_pcie_ports         = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.pmem_namespaces        = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.quobyte_client_cfg     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rbd_secret_uuid        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rbd_user               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rescue_image_id        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rescue_kernel_id       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.rx_queue_size          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.smbfs_mount_options    =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.snapshot_compression   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.snapshot_image_format  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.sparse_logical_volumes = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.swtpm_enabled          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.swtpm_group            = tss {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.swtpm_user             = tss {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.sysinfo_serial         = unique {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.tb_cache_size          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.tx_queue_size          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.uid_maps               = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.use_virtio_for_bridges = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.virt_type              = kvm {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.volume_clear           = zero {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.volume_clear_size      = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.volume_use_multipath   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_cache_path   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.auth_section           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.auth_type              = password {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.cafile                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.certfile               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.collect_timing         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.connect_retries        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.connect_retry_delay    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.default_floating_pool  = public {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.endpoint_override      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.extension_sync_interval = 600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.http_retries           = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.insecure               = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.keyfile                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.max_version            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.min_version            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.ovs_bridge             = br-int {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.physnets               = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.region_name            = RegionOne {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.service_metadata_proxy = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.service_name           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.service_type           = network {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.split_loggers          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.status_code_retries    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.timeout                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] neutron.version                = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] notifications.bdms_in_notifications = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] notifications.default_level    = INFO {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] notifications.notification_format = unversioned {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] notifications.notify_on_state_change = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] pci.alias                      = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] pci.device_spec                = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] pci.report_in_placement        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.auth_section         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.auth_type            = password {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.cafile               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.certfile             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.collect_timing       = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.connect_retries      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.connect_retry_delay  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.default_domain_id    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.default_domain_name  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.domain_id            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.domain_name          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.endpoint_override    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.insecure             = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.keyfile              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.max_version          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.min_version          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.password             = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.project_domain_id    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.project_domain_name  = Default {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.project_id           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.project_name         = service {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.region_name          = RegionOne {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.service_name         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.service_type         = placement {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.split_loggers        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.status_code_retries  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.system_scope         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.timeout              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.trust_id             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.user_domain_id       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.user_domain_name     = Default {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.user_id              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.username             = placement {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] placement.version              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.cores                    = 20 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.count_usage_from_placement = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.injected_file_content_bytes = 10240 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.injected_file_path_length = 255 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.injected_files           = 5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.instances                = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.key_pairs                = 100 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.metadata_items           = 128 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.ram                      = 51200 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.recheck_quota            = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.server_group_members     = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] quota.server_groups            = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rdp.enabled                    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.image_metadata_prefilter = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.max_attempts         = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.max_placement_results = 1000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] scheduler.workers              = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.host_subset_size = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.isolated_hosts = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.isolated_images = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.pci_in_placement = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.track_instance_changes = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metrics.required               = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metrics.weight_multiplier      = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] metrics.weight_setting         = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] serial_console.enabled         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] serial_console.port_range      = 10000:20000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] serial_console.serialproxy_port = 6083 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.auth_section      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.auth_type         = password {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.cafile            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.certfile          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.collect_timing    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.insecure          = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.keyfile           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.send_service_user_token = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.split_loggers     = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] service_user.timeout           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.agent_enabled            = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.enabled                  = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.html5proxy_port          = 6082 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.image_compression        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.jpeg_compression         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.playback_compression     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.server_listen            = 127.0.0.1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.streaming_mode           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] spice.zlib_compression         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] upgrade_levels.baseapi         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] upgrade_levels.cert            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] upgrade_levels.compute         = auto {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] upgrade_levels.conductor       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] upgrade_levels.scheduler       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.cafile = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.certfile = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.insecure = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vendordata_dynamic_auth.timeout = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.api_retry_count         = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.ca_file                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.cache_prefix            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.cluster_name            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.connection_pool_size    = 10 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.console_delay_seconds   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.datastore_regex         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.host_ip                 = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.host_password           = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.host_port               = 443 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.host_username           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.insecure                = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.integration_bridge      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.maximum_objects         = 100 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.pbm_default_policy      = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.pbm_enabled             = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.pbm_wsdl_location       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.serial_port_proxy_uri   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.serial_port_service_uri = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.task_poll_interval      = 0.5 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.use_linked_clone        = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.vnc_keymap              = en-us {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.vnc_port                = 5900 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vmware.vnc_port_total          = 10000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.auth_schemes               = ['none'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.enabled                    = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.novncproxy_port            = 6080 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.vencrypt_ca_certs          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.vencrypt_client_cert       = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vnc.vencrypt_client_key        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.disable_rootwrap   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.enable_numa_live_migration = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.libvirt_disable_apic = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.client_socket_timeout     = 900 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.default_pool_size         = 1000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.keep_alive                = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.max_header_line           = 16384 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.ssl_ca_file               = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.ssl_cert_file             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.ssl_key_file              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.tcp_keepidle              = 600 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] zvm.ca_file                    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] zvm.cloud_connector_url        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] zvm.reachable_timeout          = 300 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.enforce_scope      = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.policy_default_rule = default {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.connection_string     = messaging:// {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.enabled               = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.es_doc_type           = notification {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.es_scroll_size        = 10000 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.es_scroll_time        = 2m {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.filter_error_trace    = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.hmac_keys             = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.sentinel_service_name = mymaster {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.socket_timeout        = 0.1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.trace_requests        = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler.trace_sqlalchemy      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler_jaeger.process_tags   = {} {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] profiler_otlp.service_name_prefix = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] remote_debug.host              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] remote_debug.port              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.auth_section        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.auth_type           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.cafile              = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.certfile            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.collect_timing      = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.connect_retries     = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.connect_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.endpoint_id         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.endpoint_override   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.insecure            = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.keyfile             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.max_version         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.min_version         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.region_name         = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.service_name        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.service_type        = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.split_loggers       = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.status_code_retries = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.status_code_retry_delay = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.timeout             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.valid_interfaces    = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_limit.version             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_reports.file_event_handler = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] oslo_reports.log_dir           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_ovs_privileged.group  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] vif_plug_ovs_privileged.user   = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.isolate_vif         = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] os_brick.lock_path             = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] privsep_osbrick.capabilities   = [21] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] privsep_osbrick.group          = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] privsep_osbrick.helper_command = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] privsep_osbrick.user           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] nova_sys_admin.group           = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] nova_sys_admin.helper_command  = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] nova_sys_admin.user            = None {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG oslo_service.service [None req-ccd52ae9-6078-4ec3-a301-22e7ad7504f7 None None] ******************************************************************************** {{(pid=74582) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 03 13:42:39 user nova-compute[74582]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Connecting to libvirt: qemu:///system {{(pid=74582) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7f88d12f50> {{(pid=74582) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 03 13:42:39 user nova-compute[74582]: libvirt:  error : internal error: could not initialize domain event timer
Nov 03 13:42:39 user nova-compute[74582]: WARNING nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7f88d12f50> {{(pid=74582) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Starting native event thread {{(pid=74582) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Starting green dispatch thread {{(pid=74582) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Starting connection event dispatch thread {{(pid=74582) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 03 13:42:39 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Connection event '1' reason 'None'
Nov 03 13:42:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 13:42:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.mount [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Initialising _HostMountState generation 0 {{(pid=74582) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 03 13:42:47 user nova-compute[74582]: INFO nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host capabilities <capabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <host>
Nov 03 13:42:47 user nova-compute[74582]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 03 13:42:47 user nova-compute[74582]:     <cpu>
Nov 03 13:42:47 user nova-compute[74582]:       <arch>x86_64</arch>
Nov 03 13:42:47 user nova-compute[74582]:       <model>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <microcode version='1070'/>
Nov 03 13:42:47 user nova-compute[74582]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='osxsave'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='invtsc'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='rsba'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature name='skip-l1dfl-vmentry'/>
Nov 03 13:42:47 user nova-compute[74582]:       <pages unit='KiB' size='4'/>
Nov 03 13:42:47 user nova-compute[74582]:       <pages unit='KiB' size='2048'/>
Nov 03 13:42:47 user nova-compute[74582]:     </cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <power_management>
Nov 03 13:42:47 user nova-compute[74582]:       <suspend_mem/>
Nov 03 13:42:47 user nova-compute[74582]:       <suspend_disk/>
Nov 03 13:42:47 user nova-compute[74582]:       <suspend_hybrid/>
Nov 03 13:42:47 user nova-compute[74582]:     </power_management>
Nov 03 13:42:47 user nova-compute[74582]:     <iommu support='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <migration_features>
Nov 03 13:42:47 user nova-compute[74582]:       <live/>
Nov 03 13:42:47 user nova-compute[74582]:       <uri_transports>
Nov 03 13:42:47 user nova-compute[74582]:         <uri_transport>tcp</uri_transport>
Nov 03 13:42:47 user nova-compute[74582]:         <uri_transport>rdma</uri_transport>
Nov 03 13:42:47 user nova-compute[74582]:       </uri_transports>
Nov 03 13:42:47 user nova-compute[74582]:     </migration_features>
Nov 03 13:42:47 user nova-compute[74582]:     <topology>
Nov 03 13:42:47 user nova-compute[74582]:       <cells num='2'>
Nov 03 13:42:47 user nova-compute[74582]:         <cell id='0'>
Nov 03 13:42:47 user nova-compute[74582]:           <memory unit='KiB'>8189224</memory>
Nov 03 13:42:47 user nova-compute[74582]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 03 13:42:47 user nova-compute[74582]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 13:42:47 user nova-compute[74582]:           <distances>
Nov 03 13:42:47 user nova-compute[74582]:             <sibling id='0' value='10'/>
Nov 03 13:42:47 user nova-compute[74582]:             <sibling id='1' value='20'/>
Nov 03 13:42:47 user nova-compute[74582]:           </distances>
Nov 03 13:42:47 user nova-compute[74582]:           <cpus num='6'>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 03 13:42:47 user nova-compute[74582]:           </cpus>
Nov 03 13:42:47 user nova-compute[74582]:         </cell>
Nov 03 13:42:47 user nova-compute[74582]:         <cell id='1'>
Nov 03 13:42:47 user nova-compute[74582]:           <memory unit='KiB'>8206460</memory>
Nov 03 13:42:47 user nova-compute[74582]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 03 13:42:47 user nova-compute[74582]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 13:42:47 user nova-compute[74582]:           <distances>
Nov 03 13:42:47 user nova-compute[74582]:             <sibling id='0' value='20'/>
Nov 03 13:42:47 user nova-compute[74582]:             <sibling id='1' value='10'/>
Nov 03 13:42:47 user nova-compute[74582]:           </distances>
Nov 03 13:42:47 user nova-compute[74582]:           <cpus num='6'>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 03 13:42:47 user nova-compute[74582]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 03 13:42:47 user nova-compute[74582]:           </cpus>
Nov 03 13:42:47 user nova-compute[74582]:         </cell>
Nov 03 13:42:47 user nova-compute[74582]:       </cells>
Nov 03 13:42:47 user nova-compute[74582]:     </topology>
Nov 03 13:42:47 user nova-compute[74582]:     <cache>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 03 13:42:47 user nova-compute[74582]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 03 13:42:47 user nova-compute[74582]:     </cache>
Nov 03 13:42:47 user nova-compute[74582]:     <secmodel>
Nov 03 13:42:47 user nova-compute[74582]:       <model>apparmor</model>
Nov 03 13:42:47 user nova-compute[74582]:       <doi>0</doi>
Nov 03 13:42:47 user nova-compute[74582]:     </secmodel>
Nov 03 13:42:47 user nova-compute[74582]:     <secmodel>
Nov 03 13:42:47 user nova-compute[74582]:       <model>dac</model>
Nov 03 13:42:47 user nova-compute[74582]:       <doi>0</doi>
Nov 03 13:42:47 user nova-compute[74582]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 03 13:42:47 user nova-compute[74582]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 03 13:42:47 user nova-compute[74582]:     </secmodel>
Nov 03 13:42:47 user nova-compute[74582]:   </host>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='alpha'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>clipper</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='armv6l'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>spitz</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>nuri</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>kzm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sx1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>z2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>tosa</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>n810</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>n800</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>terrier</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>midway</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>microbit</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>verdex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>highbank</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>akita</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>connex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>collie</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='armv7l'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>spitz</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>nuri</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>kzm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sx1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>z2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>tosa</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>n810</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>n800</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>terrier</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>midway</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>microbit</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>verdex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>highbank</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>akita</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>connex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>collie</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='aarch64'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>spitz</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>nuri</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>kzm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sx1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>z2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>tosa</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>n810</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>n800</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>terrier</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>midway</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>microbit</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>verdex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>raspi3b</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>highbank</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>akita</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>connex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>collie</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <acpi default='on' toggle='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='cris'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='i686'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>isapc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>microvm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='kvm'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <pae/>
Nov 03 13:42:47 user nova-compute[74582]:       <nonpae/>
Nov 03 13:42:47 user nova-compute[74582]:       <acpi default='on' toggle='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:       <apic default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='m68k'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>an5206</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>q800</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>next-cube</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='microblaze'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='microblazeel'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='mips'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='16'>malta</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='mipsel'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='16'>malta</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='mips64'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='16'>malta</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>pica61</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>magnum</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='mips64el'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='16'>malta</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>pica61</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>magnum</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='16'>boston</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='ppc'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mac99</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>40p</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>taihu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='ppc64'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>taihu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>40p</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mac99</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='ppc64le'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>taihu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>40p</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>mac99</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='riscv32'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='8'>spike</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>opentitan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='8'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='riscv64'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='8'>spike</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>shakti_c</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='8'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='s390x'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='sh4'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>shix</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>r2d</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='sh4eb'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>shix</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>r2d</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='sparc'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>SS-5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>SS-20</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>LX</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>SS-4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>SS-10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>Voyager</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='sparc64'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sun4u</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>niagara</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>sun4v</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='x86_64'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>64</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='1'>isapc</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>microvm</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='kvm'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <acpi default='on' toggle='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:       <apic default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='xtensa'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>sim</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>kc705</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ml605</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx200</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx60</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]:   <guest>
Nov 03 13:42:47 user nova-compute[74582]:     <os_type>hvm</os_type>
Nov 03 13:42:47 user nova-compute[74582]:     <arch name='xtensaeb'>
Nov 03 13:42:47 user nova-compute[74582]:       <wordsize>32</wordsize>
Nov 03 13:42:47 user nova-compute[74582]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='4'>sim</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>kc705</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ml605</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>virt</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx200</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>lx60</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 13:42:47 user nova-compute[74582]:       <domain type='qemu'/>
Nov 03 13:42:47 user nova-compute[74582]:     </arch>
Nov 03 13:42:47 user nova-compute[74582]:     <features>
Nov 03 13:42:47 user nova-compute[74582]:       <cpuselection/>
Nov 03 13:42:47 user nova-compute[74582]:       <deviceboot/>
Nov 03 13:42:47 user nova-compute[74582]:       <disksnapshot default='on' toggle='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     </features>
Nov 03 13:42:47 user nova-compute[74582]:   </guest>
Nov 03 13:42:47 user nova-compute[74582]: </capabilities>
Nov 03 13:42:47 user nova-compute[74582]: 
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-q35-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>i686</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='288'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'/>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='lm'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-i440fx-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>i686</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='255'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'/>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='lm'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ide</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-i440fx-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>i686</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='255'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'/>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='lm'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ide</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-q35-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>i686</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='288'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'/>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='lm'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-q35-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>x86_64</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='288'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>efi</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='invtsc'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='rsba'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-i440fx-jammy</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>x86_64</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='255'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>efi</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='invtsc'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='rsba'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ide</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-i440fx-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>x86_64</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='255'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>efi</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='invtsc'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='rsba'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ide</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 03 13:42:47 user nova-compute[74582]: <domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 13:42:47 user nova-compute[74582]:   <domain>kvm</domain>
Nov 03 13:42:47 user nova-compute[74582]:   <machine>pc-q35-6.2</machine>
Nov 03 13:42:47 user nova-compute[74582]:   <arch>x86_64</arch>
Nov 03 13:42:47 user nova-compute[74582]:   <vcpu max='288'/>
Nov 03 13:42:47 user nova-compute[74582]:   <iothreads supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:   <os supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='firmware'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>efi</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:     <loader supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>rom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pflash</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='readonly'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='secure'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>yes</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>no</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </loader>
Nov 03 13:42:47 user nova-compute[74582]:   </os>
Nov 03 13:42:47 user nova-compute[74582]:   <cpu>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-passthrough' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='hostPassthroughMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='maximum' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='maximumMigratable'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>on</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>off</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='host-model' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <vendor>Intel</vendor>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ss'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='vmx'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pcid'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='hypervisor'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arat'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='umip'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='md-clear'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='invtsc'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibpb'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='ibrs'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-stibp'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='rsba'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='erms'/>
Nov 03 13:42:47 user nova-compute[74582]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:     <mode name='custom' supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>qemu64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>qemu32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>phenom</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>pentium</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>n270</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm64</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>kvm32</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>coreduo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>core2duo</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>athlon</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Westmere</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Snowridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Skylake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>SandyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Penryn</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G5</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G4</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G3</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Opteron_G2</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Opteron_G1</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>IvyBridge</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Icelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Haswell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Rome</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-Milan</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>EPYC</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Dhyana</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cooperlake</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>Conroe</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='no'>Broadwell</model>
Nov 03 13:42:47 user nova-compute[74582]:       <model usable='yes'>486</model>
Nov 03 13:42:47 user nova-compute[74582]:     </mode>
Nov 03 13:42:47 user nova-compute[74582]:   </cpu>
Nov 03 13:42:47 user nova-compute[74582]:   <memoryBacking supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:     <enum name='sourceType'>
Nov 03 13:42:47 user nova-compute[74582]:       <value>file</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>anonymous</value>
Nov 03 13:42:47 user nova-compute[74582]:       <value>memfd</value>
Nov 03 13:42:47 user nova-compute[74582]:     </enum>
Nov 03 13:42:47 user nova-compute[74582]:   </memoryBacking>
Nov 03 13:42:47 user nova-compute[74582]:   <devices>
Nov 03 13:42:47 user nova-compute[74582]:     <disk supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='diskDevice'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>disk</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cdrom</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>floppy</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>lun</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='bus'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>fdc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sata</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </disk>
Nov 03 13:42:47 user nova-compute[74582]:     <graphics supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='type'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>sdl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vnc</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>spice</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egl-headless</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </graphics>
Nov 03 13:42:47 user nova-compute[74582]:     <video supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='modelType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>cirrus</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>vmvga</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>qxl</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>none</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>bochs</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>ramfb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </video>
Nov 03 13:42:47 user nova-compute[74582]:     <hostdev supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='mode'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>subsystem</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='startupPolicy'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>default</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>mandatory</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>requisite</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>optional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='subsysType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>usb</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>pci</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>scsi</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='capsType'/>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='pciBackend'/>
Nov 03 13:42:47 user nova-compute[74582]:     </hostdev>
Nov 03 13:42:47 user nova-compute[74582]:     <rng supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtio-non-transitional</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>random</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>egd</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>builtin</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </rng>
Nov 03 13:42:47 user nova-compute[74582]:     <filesystem supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='driverType'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>path</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>handle</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>virtiofs</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </filesystem>
Nov 03 13:42:47 user nova-compute[74582]:     <tpm supported='yes'>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='model'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-tis</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>tpm-crb</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:       <enum name='backendModel'>
Nov 03 13:42:47 user nova-compute[74582]:         <value>passthrough</value>
Nov 03 13:42:47 user nova-compute[74582]:         <value>emulator</value>
Nov 03 13:42:47 user nova-compute[74582]:       </enum>
Nov 03 13:42:47 user nova-compute[74582]:     </tpm>
Nov 03 13:42:47 user nova-compute[74582]:   </devices>
Nov 03 13:42:47 user nova-compute[74582]:   <features>
Nov 03 13:42:47 user nova-compute[74582]:     <gic supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:     <vmcoreinfo supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <genid supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backingStoreInput supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <backup supported='yes'/>
Nov 03 13:42:47 user nova-compute[74582]:     <sev supported='no'/>
Nov 03 13:42:47 user nova-compute[74582]:   </features>
Nov 03 13:42:47 user nova-compute[74582]: </domainCapabilities>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74582) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74582) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Checking secure boot support for host arch (x86_64) {{(pid=74582) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 03 13:42:47 user nova-compute[74582]: INFO nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Secure Boot support detected
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] cpu compare xml: <cpu match="exact">
Nov 03 13:42:47 user nova-compute[74582]:   <model>Nehalem</model>
Nov 03 13:42:47 user nova-compute[74582]: </cpu>
Nov 03 13:42:47 user nova-compute[74582]:  {{(pid=74582) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 03 13:42:47 user nova-compute[74582]: INFO nova.virt.node [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Generated node identity baed4ae8-b8da-4af7-979b-b6805c6b4e5e
Nov 03 13:42:47 user nova-compute[74582]: INFO nova.virt.node [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Wrote node identity baed4ae8-b8da-4af7-979b-b6805c6b4e5e to /opt/stack/data/nova/compute_id
Nov 03 13:42:47 user nova-compute[74582]: WARNING nova.compute.manager [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Compute nodes ['baed4ae8-b8da-4af7-979b-b6805c6b4e5e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 03 13:42:47 user nova-compute[74582]: INFO nova.compute.manager [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 03 13:42:47 user nova-compute[74582]: WARNING nova.compute.manager [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 13:42:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:42:47 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:42:47 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Hypervisor/Node resource view: name=user free_ram=10990MB free_disk=26.2509765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:42:47 user nova-compute[74582]: WARNING nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] No compute node record for user:baed4ae8-b8da-4af7-979b-b6805c6b4e5e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host baed4ae8-b8da-4af7-979b-b6805c6b4e5e could not be found.
Nov 03 13:42:47 user nova-compute[74582]: INFO nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Compute node record created for user:user with uuid: baed4ae8-b8da-4af7-979b-b6805c6b4e5e
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:42:47 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:42:48 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] [req-551c6601-a450-46a9-9015-1e7951ad00ea] Created resource provider record via placement API for resource provider with UUID baed4ae8-b8da-4af7-979b-b6805c6b4e5e and name user.
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74582) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 03 13:42:48 user nova-compute[74582]: INFO nova.virt.libvirt.host [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] kernel doesn't support AMD SEV
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Libvirt baseline CPU <cpu>
Nov 03 13:42:48 user nova-compute[74582]:   <arch>x86_64</arch>
Nov 03 13:42:48 user nova-compute[74582]:   <model>Nehalem</model>
Nov 03 13:42:48 user nova-compute[74582]:   <vendor>Intel</vendor>
Nov 03 13:42:48 user nova-compute[74582]:   <topology sockets="6" cores="1" threads="1"/>
Nov 03 13:42:48 user nova-compute[74582]: </cpu>
Nov 03 13:42:48 user nova-compute[74582]:  {{(pid=74582) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Updated inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Updating resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e generation from 0 to 1 during operation: update_inventory {{(pid=74582) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Updating resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e generation from 1 to 2 during operation: update_traits {{(pid=74582) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.service [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Creating RPC server for service compute {{(pid=74582) start /opt/stack/nova/nova/service.py:182}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.service [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] Join ServiceGroup membership for this service compute {{(pid=74582) start /opt/stack/nova/nova/service.py:199}}
Nov 03 13:42:48 user nova-compute[74582]: DEBUG nova.servicegroup.drivers.db [None req-87635e92-6abc-48b1-a186-b809eb399c6d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74582) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 03 13:43:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:43:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:43:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=10434MB free_disk=26.154911041259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:43:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:44:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:44:40 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:44:40 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=10371MB free_disk=26.222434997558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:44:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:44:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:44:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:44:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:44:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:44:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:45:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:45:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=10334MB free_disk=26.103694915771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:45:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:45:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:45:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:45:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:45:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:46:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:46:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:46:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=10324MB free_disk=25.969165802001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:46:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:46:44 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:46:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:46:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:46:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:47:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:16 user nova-compute[74582]: INFO nova.compute.claims [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Claim successful on node user
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.309s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:16 user nova-compute[74582]: INFO nova.compute.claims [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Claim successful on node user
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Creating image(s)
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "/opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.policy [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e900eb8f4f6548f183010bc08a3c66f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc44a2fb46b4a649544d7e506a2d96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:17 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.virt.images [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] d1bad2f4-1913-4064-b654-ebb096d97d3b was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.part /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.policy [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2790fcec7e2e4ad0b653e5d45c98372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625c2271dab47af9751af0bb23fcd64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:17 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Creating image(s)
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "/opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "/opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "/opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.part /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.converted" returned: 0 in 0.251s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.398s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:18 user nova-compute[74582]: INFO oslo.privsep.daemon [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxliezjqk/privsep.sock']
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.302s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:18 user sudo[83891]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxliezjqk/privsep.sock
Nov 03 13:47:18 user sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:18 user nova-compute[74582]: INFO nova.compute.claims [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Claim successful on node user
Nov 03 13:47:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Successfully created port: 6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.276s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:19 user nova-compute[74582]: INFO nova.compute.claims [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Claim successful on node user
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Successfully created port: aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Creating image(s)
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.policy [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ee2e8967900436e874e86e6dd64ce72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867ccc345ce547daa6a83fe5f13c74b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.046s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:19 user nova-compute[74582]: INFO nova.compute.claims [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Claim successful on node user
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:19 user sudo[83891]: pam_unix(sudo:session): session closed for user root
Nov 03 13:47:19 user nova-compute[74582]: INFO oslo.privsep.daemon [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Spawned new privsep daemon via rootwrap
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:19 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 13:47:19 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 13:47:19 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 13:47:19 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83895
Nov 03 13:47:19 user nova-compute[74582]: WARNING oslo_privsep.priv_context [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] privsep daemon already running
Nov 03 13:47:19 user nova-compute[74582]: WARNING oslo_privsep.priv_context [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] privsep daemon already running
Nov 03 13:47:19 user nova-compute[74582]: DEBUG nova.policy [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2857caf27f24ebc895421391f498e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1d4212d1484dd1b416342134f844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Creating image(s)
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.202s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Creating image(s)
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "/opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk 1073741824" returned: 0 in 0.079s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.policy [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f64445061a214d13992b8b3bbacfb0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd438a60c19854c4a93593908fb9b4390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.284s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.162s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.215s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.215s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk 1073741824" returned: 0 in 0.053s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.581s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Cannot resize image /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Ensure instance console log exists: /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk 1073741824" returned: 0 in 0.055s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.810s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Cannot resize image /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Ensure instance console log exists: /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk 1073741824" returned: 0 in 0.076s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.842s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Cannot resize image /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Ensure instance console log exists: /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Successfully updated port: aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Successfully updated port: 6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquired lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.202s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.225s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk 1073741824" returned: 0 in 0.050s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Cannot resize image /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Ensure instance console log exists: /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Successfully created port: 2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Received event network-changed-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Refreshing instance network info cache due to event network-changed-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] Acquiring lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.258s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-changed-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Refreshing instance network info cache due to event network-changed-6bc3fd6c-127e-4a84-8ba8-89c25c66543e. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] Acquiring lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Successfully created port: 7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Cannot resize image /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Ensure instance console log exists: /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updating instance_info_cache with network_info: [{"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Releasing lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Instance network_info: |[{"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] Acquired lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.neutron [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Refreshing network info cache for port 6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Start _get_guest_xml network_info=[{"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-139702557',display_name='tempest-ServersNegativeTestJSON-server-139702557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-139702557',id=2,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1625c2271dab47af9751af0bb23fcd64',ramdisk_id='',reservation_id='r-1ar1p1s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-147568106',owner_user_name='tempest-ServersNegativeTestJSON-147568106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:18Z,user_data=None,user_id='2790fcec7e2e4ad0b653e5d45c98372e',uuid=59ca7381-f253-4009-8c29-f43ed1b335a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converting VIF {"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lazy-loading 'pci_devices' on Instance uuid 59ca7381-f253-4009-8c29-f43ed1b335a3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:22 user nova-compute[74582]:   <uuid>59ca7381-f253-4009-8c29-f43ed1b335a3</uuid>
Nov 03 13:47:22 user nova-compute[74582]:   <name>instance-00000002</name>
Nov 03 13:47:22 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:22 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:22 user nova-compute[74582]:   <metadata>
Nov 03 13:47:22 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:22 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:22 user nova-compute[74582]:       <nova:name>tempest-ServersNegativeTestJSON-server-139702557</nova:name>
Nov 03 13:47:22 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:22</nova:creationTime>
Nov 03 13:47:22 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:22 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:22 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:22 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:user uuid="2790fcec7e2e4ad0b653e5d45c98372e">tempest-ServersNegativeTestJSON-147568106-project-member</nova:user>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:project uuid="1625c2271dab47af9751af0bb23fcd64">tempest-ServersNegativeTestJSON-147568106</nova:project>
Nov 03 13:47:22 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:22 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:22 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:22 user nova-compute[74582]:         <nova:port uuid="6bc3fd6c-127e-4a84-8ba8-89c25c66543e">
Nov 03 13:47:22 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 13:47:22 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:22 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:22 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:22 user nova-compute[74582]:   </metadata>
Nov 03 13:47:22 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:22 user nova-compute[74582]:     <system>
Nov 03 13:47:22 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:22 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:22 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:22 user nova-compute[74582]:       <entry name="serial">59ca7381-f253-4009-8c29-f43ed1b335a3</entry>
Nov 03 13:47:22 user nova-compute[74582]:       <entry name="uuid">59ca7381-f253-4009-8c29-f43ed1b335a3</entry>
Nov 03 13:47:22 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:22 user nova-compute[74582]:     </system>
Nov 03 13:47:22 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:22 user nova-compute[74582]:   <os>
Nov 03 13:47:22 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:22 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:22 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:22 user nova-compute[74582]:   </os>
Nov 03 13:47:22 user nova-compute[74582]:   <features>
Nov 03 13:47:22 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:22 user nova-compute[74582]:     <apic/>
Nov 03 13:47:22 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:22 user nova-compute[74582]:   </features>
Nov 03 13:47:22 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:22 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:22 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:22 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:22 user nova-compute[74582]:   </clock>
Nov 03 13:47:22 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:22 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:22 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:22 user nova-compute[74582]:   </cpu>
Nov 03 13:47:22 user nova-compute[74582]:   <devices>
Nov 03 13:47:22 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:22 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:22 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk"/>
Nov 03 13:47:22 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:22 user nova-compute[74582]:     </disk>
Nov 03 13:47:22 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:22 user nova-compute[74582]:       <mac address="fa:16:3e:59:b4:cd"/>
Nov 03 13:47:22 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:22 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:22 user nova-compute[74582]:       <target dev="tap6bc3fd6c-12"/>
Nov 03 13:47:22 user nova-compute[74582]:     </interface>
Nov 03 13:47:22 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:22 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/console.log" append="off"/>
Nov 03 13:47:22 user nova-compute[74582]:     </serial>
Nov 03 13:47:22 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:22 user nova-compute[74582]:     <video>
Nov 03 13:47:22 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:22 user nova-compute[74582]:     </video>
Nov 03 13:47:22 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:22 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:22 user nova-compute[74582]:     </rng>
Nov 03 13:47:22 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:22 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:22 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:22 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:22 user nova-compute[74582]:   </devices>
Nov 03 13:47:22 user nova-compute[74582]: </domain>
Nov 03 13:47:22 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-139702557',display_name='tempest-ServersNegativeTestJSON-server-139702557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-139702557',id=2,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1625c2271dab47af9751af0bb23fcd64',ramdisk_id='',reservation_id='r-1ar1p1s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-147568106',owner_user_name='tempest-ServersNegativeTestJSON-147568106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:18Z,user_data=None,user_id='2790fcec7e2e4ad0b653e5d45c98372e',uuid=59ca7381-f253-4009-8c29-f43ed1b335a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converting VIF {"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG os_vif [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Created schema index Interface.name {{(pid=74582) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Created schema index Port.name {{(pid=74582) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Created schema index Bridge.name {{(pid=74582) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [POLLOUT] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4540ebe1-4ba0-52fe-a8cb-1465d8e995c5', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:23 user nova-compute[74582]: INFO oslo.privsep.daemon [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpcyb7qf95/privsep.sock']
Nov 03 13:47:23 user sudo[84006]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpcyb7qf95/privsep.sock
Nov 03 13:47:23 user sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Successfully created port: c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Instance network_info: |[{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] Acquired lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Refreshing network info cache for port aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Start _get_guest_xml network_info=[{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291632784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291632784',id=1,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-hi2m6bb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:17Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=76c90aa2-a787-434b-8dfd-d851ecf3cb17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'pci_devices' on Instance uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:23 user nova-compute[74582]:   <uuid>76c90aa2-a787-434b-8dfd-d851ecf3cb17</uuid>
Nov 03 13:47:23 user nova-compute[74582]:   <name>instance-00000001</name>
Nov 03 13:47:23 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:23 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:23 user nova-compute[74582]:   <metadata>
Nov 03 13:47:23 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:23 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:23 user nova-compute[74582]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1291632784</nova:name>
Nov 03 13:47:23 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:23</nova:creationTime>
Nov 03 13:47:23 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:23 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:23 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:23 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:user uuid="e900eb8f4f6548f183010bc08a3c66f4">tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member</nova:user>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:project uuid="7bc44a2fb46b4a649544d7e506a2d96b">tempest-ServerBootFromVolumeStableRescueTest-412298968</nova:project>
Nov 03 13:47:23 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:23 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:23 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:23 user nova-compute[74582]:         <nova:port uuid="aa3be249-1ae2-4fff-a10d-ca3c0f4766c0">
Nov 03 13:47:23 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 13:47:23 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:23 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:23 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:23 user nova-compute[74582]:   </metadata>
Nov 03 13:47:23 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:23 user nova-compute[74582]:     <system>
Nov 03 13:47:23 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:23 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:23 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:23 user nova-compute[74582]:       <entry name="serial">76c90aa2-a787-434b-8dfd-d851ecf3cb17</entry>
Nov 03 13:47:23 user nova-compute[74582]:       <entry name="uuid">76c90aa2-a787-434b-8dfd-d851ecf3cb17</entry>
Nov 03 13:47:23 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:23 user nova-compute[74582]:     </system>
Nov 03 13:47:23 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:23 user nova-compute[74582]:   <os>
Nov 03 13:47:23 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:23 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:23 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:23 user nova-compute[74582]:   </os>
Nov 03 13:47:23 user nova-compute[74582]:   <features>
Nov 03 13:47:23 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:23 user nova-compute[74582]:     <apic/>
Nov 03 13:47:23 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:23 user nova-compute[74582]:   </features>
Nov 03 13:47:23 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:23 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:23 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:23 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:23 user nova-compute[74582]:   </clock>
Nov 03 13:47:23 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:23 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:23 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:23 user nova-compute[74582]:   </cpu>
Nov 03 13:47:23 user nova-compute[74582]:   <devices>
Nov 03 13:47:23 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:23 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:23 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk"/>
Nov 03 13:47:23 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:23 user nova-compute[74582]:     </disk>
Nov 03 13:47:23 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:23 user nova-compute[74582]:       <mac address="fa:16:3e:4e:bf:1e"/>
Nov 03 13:47:23 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:23 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:23 user nova-compute[74582]:       <target dev="tapaa3be249-1a"/>
Nov 03 13:47:23 user nova-compute[74582]:     </interface>
Nov 03 13:47:23 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:23 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/console.log" append="off"/>
Nov 03 13:47:23 user nova-compute[74582]:     </serial>
Nov 03 13:47:23 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:23 user nova-compute[74582]:     <video>
Nov 03 13:47:23 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:23 user nova-compute[74582]:     </video>
Nov 03 13:47:23 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:23 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:23 user nova-compute[74582]:     </rng>
Nov 03 13:47:23 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:23 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:23 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:23 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:23 user nova-compute[74582]:   </devices>
Nov 03 13:47:23 user nova-compute[74582]: </domain>
Nov 03 13:47:23 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291632784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291632784',id=1,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-hi2m6bb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:17Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=76c90aa2-a787-434b-8dfd-d851ecf3cb17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG os_vif [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '166ef856-1083-5512-8c69-bf86e5325471', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Successfully updated port: 7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquired lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Successfully updated port: 2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updated VIF entry in instance network info cache for port 6bc3fd6c-127e-4a84-8ba8-89c25c66543e. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updating instance_info_cache with network_info: [{"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5f4aa88d-8750-4f75-9ef3-b0ddd4c7fe8f req-4936167b-a22c-4e3d-8a38-50b25aa0c7f8 service nova] Releasing lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-changed-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Refreshing instance network info cache due to event network-changed-7dc85b5b-09fc-488a-814e-40dc04da5ec2. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] Acquiring lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-changed-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Refreshing instance network info cache due to event network-changed-2b20a9c0-1c23-4a40-96fc-722cb901bf56. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance network_info: |[{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.neutron [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Refreshing network info cache for port 2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start _get_guest_xml network_info=[{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'pci_devices' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:24 user nova-compute[74582]:   <uuid>0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</uuid>
Nov 03 13:47:24 user nova-compute[74582]:   <name>instance-00000003</name>
Nov 03 13:47:24 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:24 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:24 user nova-compute[74582]:   <metadata>
Nov 03 13:47:24 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:24 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeTestJSON-server-2072902535</nova:name>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:24</nova:creationTime>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:24 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:24 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:user uuid="9ee2e8967900436e874e86e6dd64ce72">tempest-AttachVolumeTestJSON-331837995-project-member</nova:user>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:project uuid="867ccc345ce547daa6a83fe5f13c74b7">tempest-AttachVolumeTestJSON-331837995</nova:project>
Nov 03 13:47:24 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:port uuid="2b20a9c0-1c23-4a40-96fc-722cb901bf56">
Nov 03 13:47:24 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:47:24 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:24 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:24 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:24 user nova-compute[74582]:   </metadata>
Nov 03 13:47:24 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:24 user nova-compute[74582]:     <system>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="serial">0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="uuid">0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:24 user nova-compute[74582]:     </system>
Nov 03 13:47:24 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:24 user nova-compute[74582]:   <os>
Nov 03 13:47:24 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:24 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:24 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:24 user nova-compute[74582]:   </os>
Nov 03 13:47:24 user nova-compute[74582]:   <features>
Nov 03 13:47:24 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:24 user nova-compute[74582]:     <apic/>
Nov 03 13:47:24 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:24 user nova-compute[74582]:   </features>
Nov 03 13:47:24 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:24 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:24 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:24 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:24 user nova-compute[74582]:   </clock>
Nov 03 13:47:24 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:24 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:24 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:24 user nova-compute[74582]:   </cpu>
Nov 03 13:47:24 user nova-compute[74582]:   <devices>
Nov 03 13:47:24 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:24 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:24 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk"/>
Nov 03 13:47:24 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:24 user nova-compute[74582]:     </disk>
Nov 03 13:47:24 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:24 user nova-compute[74582]:       <mac address="fa:16:3e:75:8e:a5"/>
Nov 03 13:47:24 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:24 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:24 user nova-compute[74582]:       <target dev="tap2b20a9c0-1c"/>
Nov 03 13:47:24 user nova-compute[74582]:     </interface>
Nov 03 13:47:24 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:24 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/console.log" append="off"/>
Nov 03 13:47:24 user nova-compute[74582]:     </serial>
Nov 03 13:47:24 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:24 user nova-compute[74582]:     <video>
Nov 03 13:47:24 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:24 user nova-compute[74582]:     </video>
Nov 03 13:47:24 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:24 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:24 user nova-compute[74582]:     </rng>
Nov 03 13:47:24 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:24 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:24 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:24 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:24 user nova-compute[74582]:   </devices>
Nov 03 13:47:24 user nova-compute[74582]: </domain>
Nov 03 13:47:24 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG os_vif [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f61105e-5a86-5752-b234-3c34893df8ad', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:24 user sudo[84006]: pam_unix(sudo:session): session closed for user root
Nov 03 13:47:24 user nova-compute[74582]: INFO oslo.privsep.daemon [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Spawned new privsep daemon via rootwrap
Nov 03 13:47:24 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 13:47:24 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 13:47:24 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 03 13:47:24 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84011
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:24 user nova-compute[74582]: WARNING oslo_privsep.priv_context [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] privsep daemon already running
Nov 03 13:47:24 user nova-compute[74582]: WARNING oslo_privsep.priv_context [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] privsep daemon already running
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Releasing lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance network_info: |[{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] Acquired lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.neutron [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Refreshing network info cache for port 7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Start _get_guest_xml network_info=[{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-181316597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-181316597',id=4,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnB/utDpecLLpWTUtILHBV1NT6pvDqpn6zX57hWvTkoWDFBCkRrcegZ5fujd6+b+W18bsggPi4c5/PT7Uit2jBo0X0tGzu8GzEJ+mCoiR4yaoe2rXdTIb7RW+HfQQbKGQ==',key_name='tempest-keypair-810171847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-i93tzi7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=e6a282d9-0ea3-431e-8df4-ffe5d8ae6823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.objects.instance [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'pci_devices' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.neutron [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updated VIF entry in instance network info cache for port 2b20a9c0-1c23-4a40-96fc-722cb901bf56. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.neutron [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:24 user nova-compute[74582]:   <uuid>e6a282d9-0ea3-431e-8df4-ffe5d8ae6823</uuid>
Nov 03 13:47:24 user nova-compute[74582]:   <name>instance-00000004</name>
Nov 03 13:47:24 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:24 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:24 user nova-compute[74582]:   <metadata>
Nov 03 13:47:24 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:24 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-181316597</nova:name>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:24</nova:creationTime>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:24 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:24 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:user uuid="b2857caf27f24ebc895421391f498e01">tempest-AttachVolumeShelveTestJSON-1103257092-project-member</nova:user>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:project uuid="9f1d4212d1484dd1b416342134f844e0">tempest-AttachVolumeShelveTestJSON-1103257092</nova:project>
Nov 03 13:47:24 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:24 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:24 user nova-compute[74582]:         <nova:port uuid="7dc85b5b-09fc-488a-814e-40dc04da5ec2">
Nov 03 13:47:24 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 13:47:24 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:24 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:24 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:24 user nova-compute[74582]:   </metadata>
Nov 03 13:47:24 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:24 user nova-compute[74582]:     <system>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="serial">e6a282d9-0ea3-431e-8df4-ffe5d8ae6823</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="uuid">e6a282d9-0ea3-431e-8df4-ffe5d8ae6823</entry>
Nov 03 13:47:24 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:24 user nova-compute[74582]:     </system>
Nov 03 13:47:24 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:24 user nova-compute[74582]:   <os>
Nov 03 13:47:24 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:24 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:24 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:24 user nova-compute[74582]:   </os>
Nov 03 13:47:24 user nova-compute[74582]:   <features>
Nov 03 13:47:24 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:24 user nova-compute[74582]:     <apic/>
Nov 03 13:47:24 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:24 user nova-compute[74582]:   </features>
Nov 03 13:47:24 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:24 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:24 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:24 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:24 user nova-compute[74582]:   </clock>
Nov 03 13:47:24 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:24 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:24 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:24 user nova-compute[74582]:   </cpu>
Nov 03 13:47:24 user nova-compute[74582]:   <devices>
Nov 03 13:47:24 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:24 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:24 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk"/>
Nov 03 13:47:24 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:24 user nova-compute[74582]:     </disk>
Nov 03 13:47:24 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:24 user nova-compute[74582]:       <mac address="fa:16:3e:25:01:5f"/>
Nov 03 13:47:24 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:24 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:24 user nova-compute[74582]:       <target dev="tap7dc85b5b-09"/>
Nov 03 13:47:24 user nova-compute[74582]:     </interface>
Nov 03 13:47:24 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:24 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/console.log" append="off"/>
Nov 03 13:47:24 user nova-compute[74582]:     </serial>
Nov 03 13:47:24 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:24 user nova-compute[74582]:     <video>
Nov 03 13:47:24 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:24 user nova-compute[74582]:     </video>
Nov 03 13:47:24 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:24 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:24 user nova-compute[74582]:     </rng>
Nov 03 13:47:24 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:24 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:24 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:24 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:24 user nova-compute[74582]:   </devices>
Nov 03 13:47:24 user nova-compute[74582]: </domain>
Nov 03 13:47:24 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-181316597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-181316597',id=4,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnB/utDpecLLpWTUtILHBV1NT6pvDqpn6zX57hWvTkoWDFBCkRrcegZ5fujd6+b+W18bsggPi4c5/PT7Uit2jBo0X0tGzu8GzEJ+mCoiR4yaoe2rXdTIb7RW+HfQQbKGQ==',key_name='tempest-keypair-810171847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-i93tzi7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=e6a282d9-0ea3-431e-8df4-ffe5d8ae6823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG os_vif [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca01e8b8-336b-5d81-8637-78f37a4edfa3', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8f601d57-79e0-4a3a-be18-63c1c0029acc req-1d9bf1d4-dfa0-4d22-a351-76510f6fe500 service nova] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bc3fd6c-12, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bc3fd6c-12, col_values=(('qos', UUID('cad3add3-e85a-4ed6-8550-18644722eb56')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bc3fd6c-12, col_values=(('external_ids', {'iface-id': '6bc3fd6c-127e-4a84-8ba8-89c25c66543e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b4:cd', 'vm-uuid': '59ca7381-f253-4009-8c29-f43ed1b335a3'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: INFO os_vif [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12')
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa3be249-1a, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa3be249-1a, col_values=(('qos', UUID('ca07a550-aa4a-4ba6-8cc4-d1a268b56e49')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa3be249-1a, col_values=(('external_ids', {'iface-id': 'aa3be249-1ae2-4fff-a10d-ca3c0f4766c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:bf:1e', 'vm-uuid': '76c90aa2-a787-434b-8dfd-d851ecf3cb17'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: INFO os_vif [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a')
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b20a9c0-1c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b20a9c0-1c, col_values=(('qos', UUID('3c9037c3-3ea7-4a4e-9d39-ddd9c8d19f4a')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b20a9c0-1c, col_values=(('external_ids', {'iface-id': '2b20a9c0-1c23-4a40-96fc-722cb901bf56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:8e:a5', 'vm-uuid': '0795b1b5-b17d-4cbd-ba36-f8a4de7083c2'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: INFO os_vif [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c')
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dc85b5b-09, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dc85b5b-09, col_values=(('qos', UUID('2c07ada8-ab1f-4601-bd0a-e2a0aaf82d38')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dc85b5b-09, col_values=(('external_ids', {'iface-id': '7dc85b5b-09fc-488a-814e-40dc04da5ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:01:5f', 'vm-uuid': 'e6a282d9-0ea3-431e-8df4-ffe5d8ae6823'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] No VIF found with MAC fa:16:3e:59:b4:cd, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:25 user nova-compute[74582]: INFO os_vif [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09')
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No VIF found with MAC fa:16:3e:4e:bf:1e, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No VIF found with MAC fa:16:3e:75:8e:a5, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No VIF found with MAC fa:16:3e:25:01:5f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updated VIF entry in instance network info cache for port 7dc85b5b-09fc-488a-814e-40dc04da5ec2. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8cffeee4-f5f7-4b3c-957f-9a9d594d65f9 req-d4ba7608-187d-48c1-97f8-6b49272a617c service nova] Releasing lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updated VIF entry in instance network info cache for port aa3be249-1ae2-4fff-a10d-ca3c0f4766c0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4911300-bb37-432d-a0ea-a606aec3c35d req-07ee0607-e101-414e-ad23-1e66e06f6604 service nova] Releasing lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Successfully updated port: c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquired lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-changed-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Refreshing instance network info cache due to event network-changed-c71933a3-2c2b-4986-9d51-f3f1c8978bc5. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] Acquiring lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.network.neutron [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating instance_info_cache with network_info: [{"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Releasing lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Instance network_info: |[{"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] Acquired lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Refreshing network info cache for port c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Start _get_guest_xml network_info=[{"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1365815229',display_name='tempest-AttachVolumeNegativeTest-server-1365815229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1365815229',id=5,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM0o/vV+mc8unwgXFZLFpYqmN7AGoa09tNlMbnx5NgxmS56gcNdpPq0wuwYBJ1myKFOGA7EPjCHf6W2fJx5fbsDqGUO2jqZrVXRxYQNEwQBPIHwAL9Od0ga2e6K0ndGgA==',key_name='tempest-keypair-155164618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-v1i08eri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=02c8e503-1dce-4a76-adc7-93b3f04985ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.objects.instance [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'pci_devices' on Instance uuid 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:28 user nova-compute[74582]:   <uuid>02c8e503-1dce-4a76-adc7-93b3f04985ce</uuid>
Nov 03 13:47:28 user nova-compute[74582]:   <name>instance-00000005</name>
Nov 03 13:47:28 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:28 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:28 user nova-compute[74582]:   <metadata>
Nov 03 13:47:28 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:28 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:28 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1365815229</nova:name>
Nov 03 13:47:28 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:28</nova:creationTime>
Nov 03 13:47:28 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:28 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:28 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:28 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:user uuid="f64445061a214d13992b8b3bbacfb0c0">tempest-AttachVolumeNegativeTest-1460772866-project-member</nova:user>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:project uuid="d438a60c19854c4a93593908fb9b4390">tempest-AttachVolumeNegativeTest-1460772866</nova:project>
Nov 03 13:47:28 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:28 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:28 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:28 user nova-compute[74582]:         <nova:port uuid="c71933a3-2c2b-4986-9d51-f3f1c8978bc5">
Nov 03 13:47:28 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 13:47:28 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:28 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:28 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:28 user nova-compute[74582]:   </metadata>
Nov 03 13:47:28 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:28 user nova-compute[74582]:     <system>
Nov 03 13:47:28 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:28 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:28 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:28 user nova-compute[74582]:       <entry name="serial">02c8e503-1dce-4a76-adc7-93b3f04985ce</entry>
Nov 03 13:47:28 user nova-compute[74582]:       <entry name="uuid">02c8e503-1dce-4a76-adc7-93b3f04985ce</entry>
Nov 03 13:47:28 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:28 user nova-compute[74582]:     </system>
Nov 03 13:47:28 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:28 user nova-compute[74582]:   <os>
Nov 03 13:47:28 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:28 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:28 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:28 user nova-compute[74582]:   </os>
Nov 03 13:47:28 user nova-compute[74582]:   <features>
Nov 03 13:47:28 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:28 user nova-compute[74582]:     <apic/>
Nov 03 13:47:28 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:28 user nova-compute[74582]:   </features>
Nov 03 13:47:28 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:28 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:28 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:28 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:28 user nova-compute[74582]:   </clock>
Nov 03 13:47:28 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:28 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:28 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:28 user nova-compute[74582]:   </cpu>
Nov 03 13:47:28 user nova-compute[74582]:   <devices>
Nov 03 13:47:28 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:28 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:28 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk"/>
Nov 03 13:47:28 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:28 user nova-compute[74582]:     </disk>
Nov 03 13:47:28 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:28 user nova-compute[74582]:       <mac address="fa:16:3e:f7:59:3e"/>
Nov 03 13:47:28 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:28 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:28 user nova-compute[74582]:       <target dev="tapc71933a3-2c"/>
Nov 03 13:47:28 user nova-compute[74582]:     </interface>
Nov 03 13:47:28 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:28 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/console.log" append="off"/>
Nov 03 13:47:28 user nova-compute[74582]:     </serial>
Nov 03 13:47:28 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:28 user nova-compute[74582]:     <video>
Nov 03 13:47:28 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:28 user nova-compute[74582]:     </video>
Nov 03 13:47:28 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:28 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:28 user nova-compute[74582]:     </rng>
Nov 03 13:47:28 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:28 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:28 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:28 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:28 user nova-compute[74582]:   </devices>
Nov 03 13:47:28 user nova-compute[74582]: </domain>
Nov 03 13:47:28 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1365815229',display_name='tempest-AttachVolumeNegativeTest-server-1365815229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1365815229',id=5,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM0o/vV+mc8unwgXFZLFpYqmN7AGoa09tNlMbnx5NgxmS56gcNdpPq0wuwYBJ1myKFOGA7EPjCHf6W2fJx5fbsDqGUO2jqZrVXRxYQNEwQBPIHwAL9Od0ga2e6K0ndGgA==',key_name='tempest-keypair-155164618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-v1i08eri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=02c8e503-1dce-4a76-adc7-93b3f04985ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG os_vif [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5775b4c-ba9e-5bef-82ad-0fc10dda2f9a', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc71933a3-2c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc71933a3-2c, col_values=(('qos', UUID('1453ddfc-4b6b-42d1-ba27-0980770e73c9')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc71933a3-2c, col_values=(('external_ids', {'iface-id': 'c71933a3-2c2b-4986-9d51-f3f1c8978bc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:59:3e', 'vm-uuid': '02c8e503-1dce-4a76-adc7-93b3f04985ce'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:28 user nova-compute[74582]: INFO os_vif [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c')
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:f7:59:3e, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:29 user nova-compute[74582]: DEBUG nova.network.neutron [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updated VIF entry in instance network info cache for port c71933a3-2c2b-4986-9d51-f3f1c8978bc5. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:29 user nova-compute[74582]: DEBUG nova.network.neutron [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating instance_info_cache with network_info: [{"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7e4ac28f-08db-433c-aad6-6d45d7ea743a req-4d909853-c523-4517-b2b4-d3589ba71510 service nova] Releasing lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.claims [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Claim successful on node user
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Instance spawned successfully.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance spawned successfully.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance spawned successfully.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Instance spawned successfully.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Instance spawned successfully.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Took 18.66 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Took 16.05 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Took 17.04 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Took 16.42 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Took 19.96 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Took 20.68 seconds to build instance.
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Took 18.17 seconds to build instance.
Nov 03 13:47:36 user nova-compute[74582]: INFO nova.compute.manager [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Took 17.31 seconds to build instance.
Nov 03 13:47:36 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-01a48141-791a-46a2-8136-d6b86c1caec9 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.504s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6aa105a1-2674-44a4-beac-978526417d07 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.195s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: INFO nova.compute.manager [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Took 18.15 seconds to build instance.
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cbef448-1185-45cf-85d9-b20d55605bae tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.548s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: INFO nova.compute.manager [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Took 21.08 seconds to build instance.
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f986b24-c048-4dd1-9b14-4708a39ad5d4 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.429s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-06ddf27a-e62c-40b6-853f-b40b7971ddaf tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.328s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.093s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Creating image(s)
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "/opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "/opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "/opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.policy [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d8a8463e6b44b5a49ada2835baf0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789163764134874a379056ee7cf142b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.441s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:38 user nova-compute[74582]: INFO nova.compute.claims [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Claim successful on node user
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.345s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk 1073741824" returned: 0 in 0.101s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.455s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.279s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:38 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Cannot resize image /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Ensure instance console log exists: /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.993s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:39 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 0 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.policy [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c11c727035264271af47d2822e392543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab503f4be744a5db2609583507cfc97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:39 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Creating image(s)
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "/opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "/opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "/opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "b29a4b208fc086725c85f2e42edc41f40c446818" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "b29a4b208fc086725c85f2e42edc41f40c446818" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Successfully created port: 4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.part --force-share --output=json" returned: 0 in 0.270s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG nova.virt.images [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] a409b55d-0c56-4bf4-925e-c8974e5d4349 was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.part /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.part /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.converted" returned: 0 in 0.254s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "b29a4b208fc086725c85f2e42edc41f40c446818" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.416s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 --force-share --output=json" returned: 0 in 0.221s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "b29a4b208fc086725c85f2e42edc41f40c446818" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "b29a4b208fc086725c85f2e42edc41f40c446818" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 --force-share --output=json" returned: 0 in 0.296s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818,backing_fmt=raw /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818,backing_fmt=raw /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk 1073741824" returned: 0 in 0.140s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "b29a4b208fc086725c85f2e42edc41f40c446818" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 --force-share --output=json" returned: 0 in 0.290s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Successfully created port: b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Cannot resize image /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Ensure instance console log exists: /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Successfully updated port: 4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquired lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-changed-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Refreshing instance network info cache due to event network-changed-4a75e92f-dc5c-434a-a705-c539a673e831. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] Acquiring lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating instance_info_cache with network_info: [{"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Releasing lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Instance network_info: |[{"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] Acquired lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.network.neutron [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Refreshing network info cache for port 4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Start _get_guest_xml network_info=[{"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1246411133',display_name='tempest-VolumesAdminNegativeTest-server-1246411133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1246411133',id=6,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubD9joA970Za/+EOVKy8WOkZ56ExL5EUJL+5Zb4OisZ399OLrJYn7B5YxmPZFi5VUC2Z5AH8gwodGbQtYpnyT016JX7rwXUfdhFQs+syb5BALGo3vVZmqmPqx0lXGQ8Q==',key_name='tempest-keypair-1002456884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9789163764134874a379056ee7cf142b',ramdisk_id='',reservation_id='r-z35el5lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-403557302',owner_user_name='tempest-VolumesAdminNegativeTest-403557302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d8a8463e6b44b5a49ada2835baf0d5',uuid=1294e014-eed1-4016-a1a4-c3977799f4d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converting VIF {"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'pci_devices' on Instance uuid 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:43 user nova-compute[74582]:   <uuid>1294e014-eed1-4016-a1a4-c3977799f4d4</uuid>
Nov 03 13:47:43 user nova-compute[74582]:   <name>instance-00000006</name>
Nov 03 13:47:43 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:43 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:43 user nova-compute[74582]:   <metadata>
Nov 03 13:47:43 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:43 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:43 user nova-compute[74582]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1246411133</nova:name>
Nov 03 13:47:43 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:43</nova:creationTime>
Nov 03 13:47:43 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:43 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:43 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:43 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:user uuid="d5d8a8463e6b44b5a49ada2835baf0d5">tempest-VolumesAdminNegativeTest-403557302-project-member</nova:user>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:project uuid="9789163764134874a379056ee7cf142b">tempest-VolumesAdminNegativeTest-403557302</nova:project>
Nov 03 13:47:43 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:43 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:43 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:43 user nova-compute[74582]:         <nova:port uuid="4a75e92f-dc5c-434a-a705-c539a673e831">
Nov 03 13:47:43 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 13:47:43 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:43 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:43 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:43 user nova-compute[74582]:   </metadata>
Nov 03 13:47:43 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:43 user nova-compute[74582]:     <system>
Nov 03 13:47:43 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:43 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:43 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:43 user nova-compute[74582]:       <entry name="serial">1294e014-eed1-4016-a1a4-c3977799f4d4</entry>
Nov 03 13:47:43 user nova-compute[74582]:       <entry name="uuid">1294e014-eed1-4016-a1a4-c3977799f4d4</entry>
Nov 03 13:47:43 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:43 user nova-compute[74582]:     </system>
Nov 03 13:47:43 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:43 user nova-compute[74582]:   <os>
Nov 03 13:47:43 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:43 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:43 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:43 user nova-compute[74582]:   </os>
Nov 03 13:47:43 user nova-compute[74582]:   <features>
Nov 03 13:47:43 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:43 user nova-compute[74582]:     <apic/>
Nov 03 13:47:43 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:43 user nova-compute[74582]:   </features>
Nov 03 13:47:43 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:43 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:43 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:43 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:43 user nova-compute[74582]:   </clock>
Nov 03 13:47:43 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:43 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:43 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:43 user nova-compute[74582]:   </cpu>
Nov 03 13:47:43 user nova-compute[74582]:   <devices>
Nov 03 13:47:43 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:43 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:43 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk"/>
Nov 03 13:47:43 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:43 user nova-compute[74582]:     </disk>
Nov 03 13:47:43 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:43 user nova-compute[74582]:       <mac address="fa:16:3e:8f:a7:bf"/>
Nov 03 13:47:43 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:43 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:43 user nova-compute[74582]:       <target dev="tap4a75e92f-dc"/>
Nov 03 13:47:43 user nova-compute[74582]:     </interface>
Nov 03 13:47:43 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:43 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/console.log" append="off"/>
Nov 03 13:47:43 user nova-compute[74582]:     </serial>
Nov 03 13:47:43 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:43 user nova-compute[74582]:     <video>
Nov 03 13:47:43 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:43 user nova-compute[74582]:     </video>
Nov 03 13:47:43 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:43 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:43 user nova-compute[74582]:     </rng>
Nov 03 13:47:43 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:43 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:43 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:43 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:43 user nova-compute[74582]:   </devices>
Nov 03 13:47:43 user nova-compute[74582]: </domain>
Nov 03 13:47:43 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1246411133',display_name='tempest-VolumesAdminNegativeTest-server-1246411133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1246411133',id=6,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubD9joA970Za/+EOVKy8WOkZ56ExL5EUJL+5Zb4OisZ399OLrJYn7B5YxmPZFi5VUC2Z5AH8gwodGbQtYpnyT016JX7rwXUfdhFQs+syb5BALGo3vVZmqmPqx0lXGQ8Q==',key_name='tempest-keypair-1002456884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9789163764134874a379056ee7cf142b',ramdisk_id='',reservation_id='r-z35el5lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-403557302',owner_user_name='tempest-VolumesAdminNegativeTest-403557302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d8a8463e6b44b5a49ada2835baf0d5',uuid=1294e014-eed1-4016-a1a4-c3977799f4d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converting VIF {"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG os_vif [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8ca45a7-6680-54db-8c19-87111426009f', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a75e92f-dc, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a75e92f-dc, col_values=(('qos', UUID('878ecd20-3992-4013-aed1-c03878003586')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a75e92f-dc, col_values=(('external_ids', {'iface-id': '4a75e92f-dc5c-434a-a705-c539a673e831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:a7:bf', 'vm-uuid': '1294e014-eed1-4016-a1a4-c3977799f4d4'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:43 user nova-compute[74582]: INFO os_vif [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc')
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No VIF found with MAC fa:16:3e:8f:a7:bf, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Successfully updated port: b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquired lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-changed-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Refreshing instance network info cache due to event network-changed-b54551bb-7df9-45cf-b125-75f48e263d65. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] Acquiring lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updated VIF entry in instance network info cache for port 4a75e92f-dc5c-434a-a705-c539a673e831. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating instance_info_cache with network_info: [{"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e7d3a56e-cad1-4446-afa5-d26db63cb62a req-ad843068-cc50-4b60-bc1a-22c9a72d8fc0 service nova] Releasing lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updating instance_info_cache with network_info: [{"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Releasing lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Instance network_info: |[{"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] Acquired lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Refreshing network info cache for port b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Start _get_guest_xml network_info=[{"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:47:29Z,direct_url=<?>,disk_format='qcow2',id=a409b55d-0c56-4bf4-925e-c8974e5d4349,min_disk=0,min_ram=0,name='',owner='27ecbafaae4248018a2a20ce24818807',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:47:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_name': '/dev/sda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'encrypted': False, 'image_id': 'a409b55d-0c56-4bf4-925e-c8974e5d4349'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:45 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:45 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:47:29Z,direct_url=<?>,disk_format='qcow2',id=a409b55d-0c56-4bf4-925e-c8974e5d4349,min_disk=0,min_ram=0,name='',owner='27ecbafaae4248018a2a20ce24818807',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:47:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-49236409',display_name='tempest-AttachSCSIVolumeTestJSON-server-49236409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-49236409',id=7,image_ref='a409b55d-0c56-4bf4-925e-c8974e5d4349',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ/VKWob2TY8crp/ZVFEROoDL86fqycXLEoect5okqSK3iFyPSgtN3omFz7Co75ktisOHwH+i0gmzpAxAB/zOAa9K40k6rsIs0/yqBOshyiwJSXMlqvQUKSR+1TwO8Vg==',key_name='tempest-keypair-1498287829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ab503f4be744a5db2609583507cfc97',ramdisk_id='',reservation_id='r-znx0srxs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a409b55d-0c56-4bf4-925e-c8974e5d4349',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-367800724',owner_user_name='tempest-AttachSCSIVolumeTestJSON-367800724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c11c727035264271af47d2822e392543',uuid=a70cc9a8-f2fd-45ed-8b66-15e0356d90c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Converting VIF {"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lazy-loading 'pci_devices' on Instance uuid a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:45 user nova-compute[74582]:   <uuid>a70cc9a8-f2fd-45ed-8b66-15e0356d90c2</uuid>
Nov 03 13:47:45 user nova-compute[74582]:   <name>instance-00000007</name>
Nov 03 13:47:45 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:45 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:45 user nova-compute[74582]:   <metadata>
Nov 03 13:47:45 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:45 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:45 user nova-compute[74582]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-49236409</nova:name>
Nov 03 13:47:45 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:45</nova:creationTime>
Nov 03 13:47:45 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:45 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:45 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:45 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:user uuid="c11c727035264271af47d2822e392543">tempest-AttachSCSIVolumeTestJSON-367800724-project-member</nova:user>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:project uuid="3ab503f4be744a5db2609583507cfc97">tempest-AttachSCSIVolumeTestJSON-367800724</nova:project>
Nov 03 13:47:45 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:45 user nova-compute[74582]:       <nova:root type="image" uuid="a409b55d-0c56-4bf4-925e-c8974e5d4349"/>
Nov 03 13:47:45 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:45 user nova-compute[74582]:         <nova:port uuid="b54551bb-7df9-45cf-b125-75f48e263d65">
Nov 03 13:47:45 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 13:47:45 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:45 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:45 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:45 user nova-compute[74582]:   </metadata>
Nov 03 13:47:45 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:45 user nova-compute[74582]:     <system>
Nov 03 13:47:45 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:45 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:45 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:45 user nova-compute[74582]:       <entry name="serial">a70cc9a8-f2fd-45ed-8b66-15e0356d90c2</entry>
Nov 03 13:47:45 user nova-compute[74582]:       <entry name="uuid">a70cc9a8-f2fd-45ed-8b66-15e0356d90c2</entry>
Nov 03 13:47:45 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:45 user nova-compute[74582]:     </system>
Nov 03 13:47:45 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:45 user nova-compute[74582]:   <os>
Nov 03 13:47:45 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:45 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:45 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:45 user nova-compute[74582]:   </os>
Nov 03 13:47:45 user nova-compute[74582]:   <features>
Nov 03 13:47:45 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:45 user nova-compute[74582]:     <apic/>
Nov 03 13:47:45 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:45 user nova-compute[74582]:   </features>
Nov 03 13:47:45 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:45 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:45 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:45 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:45 user nova-compute[74582]:   </clock>
Nov 03 13:47:45 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:45 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:45 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:45 user nova-compute[74582]:   </cpu>
Nov 03 13:47:45 user nova-compute[74582]:   <devices>
Nov 03 13:47:45 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:45 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:45 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk"/>
Nov 03 13:47:45 user nova-compute[74582]:       <target dev="sda" bus="scsi"/>
Nov 03 13:47:45 user nova-compute[74582]:       <address type="drive" controller="0" unit="0"/>
Nov 03 13:47:45 user nova-compute[74582]:     </disk>
Nov 03 13:47:45 user nova-compute[74582]:     <disk type="file" device="cdrom">
Nov 03 13:47:45 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 13:47:45 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.config"/>
Nov 03 13:47:45 user nova-compute[74582]:       <target dev="sdb" bus="scsi"/>
Nov 03 13:47:45 user nova-compute[74582]:       <address type="drive" controller="0" unit="1"/>
Nov 03 13:47:45 user nova-compute[74582]:     </disk>
Nov 03 13:47:45 user nova-compute[74582]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 03 13:47:45 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:45 user nova-compute[74582]:       <mac address="fa:16:3e:c2:83:56"/>
Nov 03 13:47:45 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:45 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:45 user nova-compute[74582]:       <target dev="tapb54551bb-7d"/>
Nov 03 13:47:45 user nova-compute[74582]:     </interface>
Nov 03 13:47:45 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:45 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/console.log" append="off"/>
Nov 03 13:47:45 user nova-compute[74582]:     </serial>
Nov 03 13:47:45 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:45 user nova-compute[74582]:     <video>
Nov 03 13:47:45 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:45 user nova-compute[74582]:     </video>
Nov 03 13:47:45 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:45 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:45 user nova-compute[74582]:     </rng>
Nov 03 13:47:45 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:45 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:45 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:45 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:45 user nova-compute[74582]:   </devices>
Nov 03 13:47:45 user nova-compute[74582]: </domain>
Nov 03 13:47:45 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-49236409',display_name='tempest-AttachSCSIVolumeTestJSON-server-49236409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-49236409',id=7,image_ref='a409b55d-0c56-4bf4-925e-c8974e5d4349',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ/VKWob2TY8crp/ZVFEROoDL86fqycXLEoect5okqSK3iFyPSgtN3omFz7Co75ktisOHwH+i0gmzpAxAB/zOAa9K40k6rsIs0/yqBOshyiwJSXMlqvQUKSR+1TwO8Vg==',key_name='tempest-keypair-1498287829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ab503f4be744a5db2609583507cfc97',ramdisk_id='',reservation_id='r-znx0srxs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a409b55d-0c56-4bf4-925e-c8974e5d4349',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-367800724',owner_user_name='tempest-AttachSCSIVolumeTestJSON-367800724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c11c727035264271af47d2822e392543',uuid=a70cc9a8-f2fd-45ed-8b66-15e0356d90c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Converting VIF {"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG os_vif [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f57068e5-5252-5224-8f09-807eeda3a698', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb54551bb-7d, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb54551bb-7d, col_values=(('qos', UUID('a91ae555-0243-4f60-b0e3-40bde0bb99cc')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb54551bb-7d, col_values=(('external_ids', {'iface-id': 'b54551bb-7df9-45cf-b125-75f48e263d65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:83:56', 'vm-uuid': 'a70cc9a8-f2fd-45ed-8b66-15e0356d90c2'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: INFO os_vif [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d')
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No BDM found with device name sda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No VIF found with MAC fa:16:3e:c2:83:56, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Using config drive
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updated VIF entry in instance network info cache for port b54551bb-7df9-45cf-b125-75f48e263d65. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updating instance_info_cache with network_info: [{"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Creating config drive at /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.config
Nov 03 13:47:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7k7jolla {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4100bc0-f8ef-45ad-89b8-6f52abdba28e req-5041e130-2b76-4e5b-9b70-9d09101294cf service nova] Releasing lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Instance spawned successfully.
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:48 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:48 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.850982666015625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7k7jolla" returned: 0 in 0.080s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:48 user nova-compute[74582]: INFO nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Took 11.14 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:48 user nova-compute[74582]: INFO nova.compute.manager [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Took 13.86 seconds to build instance.
Nov 03 13:47:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f15f5e8e-e94c-4c33-aa08-334a442bdf7d tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.059s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:47:48 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.311s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-05defa26-0de7-4af0-82b9-ca6358037803 req-c599316b-45d6-47c0-8fcd-386f03c7addb service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-05defa26-0de7-4af0-82b9-ca6358037803 req-c599316b-45d6-47c0-8fcd-386f03c7addb service nova] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-05defa26-0de7-4af0-82b9-ca6358037803 req-c599316b-45d6-47c0-8fcd-386f03c7addb service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-05defa26-0de7-4af0-82b9-ca6358037803 req-c599316b-45d6-47c0-8fcd-386f03c7addb service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-05defa26-0de7-4af0-82b9-ca6358037803 req-c599316b-45d6-47c0-8fcd-386f03c7addb service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] No waiting events found dispatching network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:50 user nova-compute[74582]: WARNING nova.compute.manager [req-05defa26-0de7-4af0-82b9-ca6358037803 req-c599316b-45d6-47c0-8fcd-386f03c7addb service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received unexpected event network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e for instance with vm_state active and task_state None.
Nov 03 13:47:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:47:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Skipping network cache update for instance because it is Building. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-7c772db3-af0f-4f86-8dc8-2b72d3015293 req-51dafeb0-260f-4c55-bc26-b9e61350f932 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Received event network-vif-plugged-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7c772db3-af0f-4f86-8dc8-2b72d3015293 req-51dafeb0-260f-4c55-bc26-b9e61350f932 service nova] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7c772db3-af0f-4f86-8dc8-2b72d3015293 req-51dafeb0-260f-4c55-bc26-b9e61350f932 service nova] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7c772db3-af0f-4f86-8dc8-2b72d3015293 req-51dafeb0-260f-4c55-bc26-b9e61350f932 service nova] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-7c772db3-af0f-4f86-8dc8-2b72d3015293 req-51dafeb0-260f-4c55-bc26-b9e61350f932 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] No waiting events found dispatching network-vif-plugged-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:51 user nova-compute[74582]: WARNING nova.compute.manager [req-7c772db3-af0f-4f86-8dc8-2b72d3015293 req-51dafeb0-260f-4c55-bc26-b9e61350f932 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Received unexpected event network-vif-plugged-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 for instance with vm_state active and task_state None.
Nov 03 13:47:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3a928a3-3479-4c90-b73b-298cc6b17a1d req-85b55934-f127-452b-a79b-6e4ba9bff81b service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3a928a3-3479-4c90-b73b-298cc6b17a1d req-85b55934-f127-452b-a79b-6e4ba9bff81b service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3a928a3-3479-4c90-b73b-298cc6b17a1d req-85b55934-f127-452b-a79b-6e4ba9bff81b service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3a928a3-3479-4c90-b73b-298cc6b17a1d req-85b55934-f127-452b-a79b-6e4ba9bff81b service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3a928a3-3479-4c90-b73b-298cc6b17a1d req-85b55934-f127-452b-a79b-6e4ba9bff81b service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:51 user nova-compute[74582]: WARNING nova.compute.manager [req-f3a928a3-3479-4c90-b73b-298cc6b17a1d req-85b55934-f127-452b-a79b-6e4ba9bff81b service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state active and task_state None.
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-4223865a-243e-4084-92e8-f64fffed5cd0 req-49c98d4e-b46e-4861-82a9-0f2d1eda414d service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4223865a-243e-4084-92e8-f64fffed5cd0 req-49c98d4e-b46e-4861-82a9-0f2d1eda414d service nova] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4223865a-243e-4084-92e8-f64fffed5cd0 req-49c98d4e-b46e-4861-82a9-0f2d1eda414d service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4223865a-243e-4084-92e8-f64fffed5cd0 req-49c98d4e-b46e-4861-82a9-0f2d1eda414d service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-4223865a-243e-4084-92e8-f64fffed5cd0 req-49c98d4e-b46e-4861-82a9-0f2d1eda414d service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] No waiting events found dispatching network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:52 user nova-compute[74582]: WARNING nova.compute.manager [req-4223865a-243e-4084-92e8-f64fffed5cd0 req-49c98d4e-b46e-4861-82a9-0f2d1eda414d service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received unexpected event network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e for instance with vm_state active and task_state None.
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:47:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Instance spawned successfully.
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:47:53 user nova-compute[74582]: INFO nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Took 13.34 seconds to spawn the instance on the hypervisor.
Nov 03 13:47:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:47:53 user nova-compute[74582]: INFO nova.compute.manager [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Took 15.31 seconds to build instance.
Nov 03 13:47:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ec3d63c-b80e-49ee-a035-76466fd7300a tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.521s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Received event network-vif-plugged-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] No waiting events found dispatching network-vif-plugged-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:53 user nova-compute[74582]: WARNING nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Received unexpected event network-vif-plugged-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] No waiting events found dispatching network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received unexpected event network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] No waiting events found dispatching network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-96d96e9e-7fe2-42e6-8946-a5b7a8a2adf1 req-d75cc41e-8338-4633-9c9d-88f2a79a9aa2 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received unexpected event network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] No waiting events found dispatching network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received unexpected event network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] No waiting events found dispatching network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received unexpected event network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:54 user nova-compute[74582]: WARNING nova.compute.manager [req-5dceba33-d52f-4b29-a8f8-69013f6d3ea4 req-3580a279-23cb-42c1-8bb7-309bd408c915 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state active and task_state None.
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:47:54 user nova-compute[74582]: INFO nova.compute.claims [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Claim successful on node user
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.675s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:47:54 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:47:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG nova.policy [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dc915d9d0264ad3bcecfc148b4fba43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f348ba8f4d64106978321c3830d41da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:47:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Creating image(s)
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "/opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "/opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.228s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.242s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk 1073741824" returned: 0 in 0.058s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:47:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Successfully created port: 042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Cannot resize image /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Ensure instance console log exists: /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Successfully updated port: 042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquired lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-changed-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Refreshing instance network info cache due to event network-changed-042a8bde-8189-485c-90da-de4b304c57ac. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] Acquiring lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:47:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updating instance_info_cache with network_info: [{"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Releasing lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Instance network_info: |[{"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] Acquired lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Refreshing network info cache for port 042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Start _get_guest_xml network_info=[{"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:47:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-658368295',display_name='tempest-VolumesAssistedSnapshotsTest-server-658368295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-658368295',id=8,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrQSSO0guUkzW9e9gIy5RjSf5ZclQhv2NjbWOlVwem3AHXKZXnLP4GmBylOIRdZpsqLS/SmLaURQ0hw3wHu/WeofwUDOlDzQ06oKgAERivn1IMAsof/Y40WLOdmGlog4g==',key_name='tempest-keypair-1087529260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f348ba8f4d64106978321c3830d41da',ramdisk_id='',reservation_id='r-524ep1cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1831984643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1831984643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc915d9d0264ad3bcecfc148b4fba43',uuid=a3eb9e0c-de33-4f7e-a7ab-cf46511353c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Converting VIF {"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lazy-loading 'pci_devices' on Instance uuid a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e9c15b-1074-4e19-ac27-7706e97eff05 req-cdeb7c95-6562-4da2-a3c4-d643e3a953a4 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e9c15b-1074-4e19-ac27-7706e97eff05 req-cdeb7c95-6562-4da2-a3c4-d643e3a953a4 service nova] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e9c15b-1074-4e19-ac27-7706e97eff05 req-cdeb7c95-6562-4da2-a3c4-d643e3a953a4 service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e9c15b-1074-4e19-ac27-7706e97eff05 req-cdeb7c95-6562-4da2-a3c4-d643e3a953a4 service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e9c15b-1074-4e19-ac27-7706e97eff05 req-cdeb7c95-6562-4da2-a3c4-d643e3a953a4 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] No waiting events found dispatching network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:57 user nova-compute[74582]: WARNING nova.compute.manager [req-83e9c15b-1074-4e19-ac27-7706e97eff05 req-cdeb7c95-6562-4da2-a3c4-d643e3a953a4 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received unexpected event network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 for instance with vm_state active and task_state None.
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:47:57 user nova-compute[74582]:   <uuid>a3eb9e0c-de33-4f7e-a7ab-cf46511353c8</uuid>
Nov 03 13:47:57 user nova-compute[74582]:   <name>instance-00000008</name>
Nov 03 13:47:57 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:47:57 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:47:57 user nova-compute[74582]:   <metadata>
Nov 03 13:47:57 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:47:57 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:47:57 user nova-compute[74582]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-658368295</nova:name>
Nov 03 13:47:57 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:47:57</nova:creationTime>
Nov 03 13:47:57 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:47:57 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:47:57 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:47:57 user nova-compute[74582]:       <nova:owner>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:user uuid="9dc915d9d0264ad3bcecfc148b4fba43">tempest-VolumesAssistedSnapshotsTest-1831984643-project-member</nova:user>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:project uuid="3f348ba8f4d64106978321c3830d41da">tempest-VolumesAssistedSnapshotsTest-1831984643</nova:project>
Nov 03 13:47:57 user nova-compute[74582]:       </nova:owner>
Nov 03 13:47:57 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:47:57 user nova-compute[74582]:       <nova:ports>
Nov 03 13:47:57 user nova-compute[74582]:         <nova:port uuid="042a8bde-8189-485c-90da-de4b304c57ac">
Nov 03 13:47:57 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:47:57 user nova-compute[74582]:         </nova:port>
Nov 03 13:47:57 user nova-compute[74582]:       </nova:ports>
Nov 03 13:47:57 user nova-compute[74582]:     </nova:instance>
Nov 03 13:47:57 user nova-compute[74582]:   </metadata>
Nov 03 13:47:57 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:47:57 user nova-compute[74582]:     <system>
Nov 03 13:47:57 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:47:57 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:47:57 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:47:57 user nova-compute[74582]:       <entry name="serial">a3eb9e0c-de33-4f7e-a7ab-cf46511353c8</entry>
Nov 03 13:47:57 user nova-compute[74582]:       <entry name="uuid">a3eb9e0c-de33-4f7e-a7ab-cf46511353c8</entry>
Nov 03 13:47:57 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:47:57 user nova-compute[74582]:     </system>
Nov 03 13:47:57 user nova-compute[74582]:   </sysinfo>
Nov 03 13:47:57 user nova-compute[74582]:   <os>
Nov 03 13:47:57 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:47:57 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:47:57 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:47:57 user nova-compute[74582]:   </os>
Nov 03 13:47:57 user nova-compute[74582]:   <features>
Nov 03 13:47:57 user nova-compute[74582]:     <acpi/>
Nov 03 13:47:57 user nova-compute[74582]:     <apic/>
Nov 03 13:47:57 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:47:57 user nova-compute[74582]:   </features>
Nov 03 13:47:57 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:47:57 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:47:57 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:47:57 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:47:57 user nova-compute[74582]:   </clock>
Nov 03 13:47:57 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:47:57 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:47:57 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:47:57 user nova-compute[74582]:   </cpu>
Nov 03 13:47:57 user nova-compute[74582]:   <devices>
Nov 03 13:47:57 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:47:57 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:47:57 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk"/>
Nov 03 13:47:57 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:47:57 user nova-compute[74582]:     </disk>
Nov 03 13:47:57 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:47:57 user nova-compute[74582]:       <mac address="fa:16:3e:c5:87:28"/>
Nov 03 13:47:57 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:57 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:47:57 user nova-compute[74582]:       <target dev="tap042a8bde-81"/>
Nov 03 13:47:57 user nova-compute[74582]:     </interface>
Nov 03 13:47:57 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:47:57 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/console.log" append="off"/>
Nov 03 13:47:57 user nova-compute[74582]:     </serial>
Nov 03 13:47:57 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:47:57 user nova-compute[74582]:     <video>
Nov 03 13:47:57 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:47:57 user nova-compute[74582]:     </video>
Nov 03 13:47:57 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:47:57 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:47:57 user nova-compute[74582]:     </rng>
Nov 03 13:47:57 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:47:57 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:47:57 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:47:57 user nova-compute[74582]:     </memballoon>
Nov 03 13:47:57 user nova-compute[74582]:   </devices>
Nov 03 13:47:57 user nova-compute[74582]: </domain>
Nov 03 13:47:57 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-658368295',display_name='tempest-VolumesAssistedSnapshotsTest-server-658368295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-658368295',id=8,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrQSSO0guUkzW9e9gIy5RjSf5ZclQhv2NjbWOlVwem3AHXKZXnLP4GmBylOIRdZpsqLS/SmLaURQ0hw3wHu/WeofwUDOlDzQ06oKgAERivn1IMAsof/Y40WLOdmGlog4g==',key_name='tempest-keypair-1087529260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f348ba8f4d64106978321c3830d41da',ramdisk_id='',reservation_id='r-524ep1cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1831984643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1831984643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc915d9d0264ad3bcecfc148b4fba43',uuid=a3eb9e0c-de33-4f7e-a7ab-cf46511353c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Converting VIF {"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG os_vif [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a91201d9-0680-50be-b9c4-e240e5cbd137', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap042a8bde-81, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap042a8bde-81, col_values=(('qos', UUID('8279088b-c9ea-43b5-881e-4e3230651570')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap042a8bde-81, col_values=(('external_ids', {'iface-id': '042a8bde-8189-485c-90da-de4b304c57ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:87:28', 'vm-uuid': 'a3eb9e0c-de33-4f7e-a7ab-cf46511353c8'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:57 user nova-compute[74582]: INFO os_vif [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81')
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] No VIF found with MAC fa:16:3e:c5:87:28, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updated VIF entry in instance network info cache for port 042a8bde-8189-485c-90da-de4b304c57ac. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updating instance_info_cache with network_info: [{"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:47:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f54a55af-4588-425c-91da-3fcb28e9541a req-2c5b793c-7ddc-44eb-8f78-acbc0a0f86c1 service nova] Releasing lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:47:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-b38ed1d2-0fb0-4482-9fda-5ed3162da7c2 req-69ba850b-a688-4f19-a99a-f174b9b68c99 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b38ed1d2-0fb0-4482-9fda-5ed3162da7c2 req-69ba850b-a688-4f19-a99a-f174b9b68c99 service nova] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b38ed1d2-0fb0-4482-9fda-5ed3162da7c2 req-69ba850b-a688-4f19-a99a-f174b9b68c99 service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b38ed1d2-0fb0-4482-9fda-5ed3162da7c2 req-69ba850b-a688-4f19-a99a-f174b9b68c99 service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-b38ed1d2-0fb0-4482-9fda-5ed3162da7c2 req-69ba850b-a688-4f19-a99a-f174b9b68c99 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] No waiting events found dispatching network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:59 user nova-compute[74582]: WARNING nova.compute.manager [req-b38ed1d2-0fb0-4482-9fda-5ed3162da7c2 req-69ba850b-a688-4f19-a99a-f174b9b68c99 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received unexpected event network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac for instance with vm_state building and task_state spawning.
Nov 03 13:47:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-aa0cd3c3-dc8d-4a8f-a427-fa0f57eff520 req-a098fa1a-e197-4ded-a3d4-b6bade3489e9 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aa0cd3c3-dc8d-4a8f-a427-fa0f57eff520 req-a098fa1a-e197-4ded-a3d4-b6bade3489e9 service nova] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aa0cd3c3-dc8d-4a8f-a427-fa0f57eff520 req-a098fa1a-e197-4ded-a3d4-b6bade3489e9 service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aa0cd3c3-dc8d-4a8f-a427-fa0f57eff520 req-a098fa1a-e197-4ded-a3d4-b6bade3489e9 service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-aa0cd3c3-dc8d-4a8f-a427-fa0f57eff520 req-a098fa1a-e197-4ded-a3d4-b6bade3489e9 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] No waiting events found dispatching network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:47:59 user nova-compute[74582]: WARNING nova.compute.manager [req-aa0cd3c3-dc8d-4a8f-a427-fa0f57eff520 req-a098fa1a-e197-4ded-a3d4-b6bade3489e9 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received unexpected event network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 for instance with vm_state active and task_state None.
Nov 03 13:47:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:47:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-9d92f8de-8208-4c6c-80d7-1b796407a0a4 req-c3456804-9773-4133-9369-8c32c6f02f7a service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9d92f8de-8208-4c6c-80d7-1b796407a0a4 req-c3456804-9773-4133-9369-8c32c6f02f7a service nova] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9d92f8de-8208-4c6c-80d7-1b796407a0a4 req-c3456804-9773-4133-9369-8c32c6f02f7a service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9d92f8de-8208-4c6c-80d7-1b796407a0a4 req-c3456804-9773-4133-9369-8c32c6f02f7a service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-9d92f8de-8208-4c6c-80d7-1b796407a0a4 req-c3456804-9773-4133-9369-8c32c6f02f7a service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] No waiting events found dispatching network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:48:01 user nova-compute[74582]: WARNING nova.compute.manager [req-9d92f8de-8208-4c6c-80d7-1b796407a0a4 req-c3456804-9773-4133-9369-8c32c6f02f7a service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received unexpected event network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac for instance with vm_state building and task_state spawning.
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:48:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Instance spawned successfully.
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:01 user nova-compute[74582]: INFO nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 03 13:48:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:48:01 user nova-compute[74582]: INFO nova.compute.manager [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Took 7.63 seconds to build instance.
Nov 03 13:48:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cd3632cf-a771-4f84-ad8f-9388e6be5924 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.842s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:48:20 user nova-compute[74582]: INFO nova.compute.claims [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Claim successful on node user
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:48:21 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.policy [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c51087d6b89d42e9890fcc9d4232e901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371a42181fb4e61981eaf7680123707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:48:21 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Creating image(s)
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "/opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "/opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "/opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk 1073741824" returned: 0 in 0.056s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.203s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Successfully created port: c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Cannot resize image /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Ensure instance console log exists: /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Successfully updated port: c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquired lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-changed-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Refreshing instance network info cache due to event network-changed-c64e3520-647a-4708-8765-bad6362ee795. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:48:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] Acquiring lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updating instance_info_cache with network_info: [{"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Releasing lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Instance network_info: |[{"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] Acquired lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.neutron [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Refreshing network info cache for port c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Start _get_guest_xml network_info=[{"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:48:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:48:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1858662947',display_name='tempest-TestVolumeSwap-server-1858662947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1858662947',id=9,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbS8Iq4oUyc0pw4rJxwDhlnU7/tD7moS83x7fS/WLocowPrk3HS86CmaELLuWDonXP0ql71IjmozEujQUf4tUSCqjH+Pys84uDXCJsHR2aduQQ7f1RgVEVoGeYVpzne2A==',key_name='tempest-keypair-1658946133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1371a42181fb4e61981eaf7680123707',ramdisk_id='',reservation_id='r-1a6cyjux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-230062966',owner_user_name='tempest-TestVolumeSwap-230062966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c51087d6b89d42e9890fcc9d4232e901',uuid=926114b3-1849-465b-94fb-3a1d6e49d56e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Converting VIF {"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lazy-loading 'pci_devices' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:48:23 user nova-compute[74582]:   <uuid>926114b3-1849-465b-94fb-3a1d6e49d56e</uuid>
Nov 03 13:48:23 user nova-compute[74582]:   <name>instance-00000009</name>
Nov 03 13:48:23 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:48:23 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:48:23 user nova-compute[74582]:   <metadata>
Nov 03 13:48:23 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:48:23 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:48:23 user nova-compute[74582]:       <nova:name>tempest-TestVolumeSwap-server-1858662947</nova:name>
Nov 03 13:48:23 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:48:23</nova:creationTime>
Nov 03 13:48:23 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:48:23 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:48:23 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:48:23 user nova-compute[74582]:       <nova:owner>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:user uuid="c51087d6b89d42e9890fcc9d4232e901">tempest-TestVolumeSwap-230062966-project-member</nova:user>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:project uuid="1371a42181fb4e61981eaf7680123707">tempest-TestVolumeSwap-230062966</nova:project>
Nov 03 13:48:23 user nova-compute[74582]:       </nova:owner>
Nov 03 13:48:23 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:48:23 user nova-compute[74582]:       <nova:ports>
Nov 03 13:48:23 user nova-compute[74582]:         <nova:port uuid="c64e3520-647a-4708-8765-bad6362ee795">
Nov 03 13:48:23 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 13:48:23 user nova-compute[74582]:         </nova:port>
Nov 03 13:48:23 user nova-compute[74582]:       </nova:ports>
Nov 03 13:48:23 user nova-compute[74582]:     </nova:instance>
Nov 03 13:48:23 user nova-compute[74582]:   </metadata>
Nov 03 13:48:23 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:48:23 user nova-compute[74582]:     <system>
Nov 03 13:48:23 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:48:23 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:48:23 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:48:23 user nova-compute[74582]:       <entry name="serial">926114b3-1849-465b-94fb-3a1d6e49d56e</entry>
Nov 03 13:48:23 user nova-compute[74582]:       <entry name="uuid">926114b3-1849-465b-94fb-3a1d6e49d56e</entry>
Nov 03 13:48:23 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:48:23 user nova-compute[74582]:     </system>
Nov 03 13:48:23 user nova-compute[74582]:   </sysinfo>
Nov 03 13:48:23 user nova-compute[74582]:   <os>
Nov 03 13:48:23 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:48:23 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:48:23 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:48:23 user nova-compute[74582]:   </os>
Nov 03 13:48:23 user nova-compute[74582]:   <features>
Nov 03 13:48:23 user nova-compute[74582]:     <acpi/>
Nov 03 13:48:23 user nova-compute[74582]:     <apic/>
Nov 03 13:48:23 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:48:23 user nova-compute[74582]:   </features>
Nov 03 13:48:23 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:48:23 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:48:23 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:48:23 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:48:23 user nova-compute[74582]:   </clock>
Nov 03 13:48:23 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:48:23 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:48:23 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:48:23 user nova-compute[74582]:   </cpu>
Nov 03 13:48:23 user nova-compute[74582]:   <devices>
Nov 03 13:48:23 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:48:23 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:48:23 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk"/>
Nov 03 13:48:23 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:48:23 user nova-compute[74582]:     </disk>
Nov 03 13:48:23 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:48:23 user nova-compute[74582]:       <mac address="fa:16:3e:bd:42:13"/>
Nov 03 13:48:23 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:48:23 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:48:23 user nova-compute[74582]:       <target dev="tapc64e3520-64"/>
Nov 03 13:48:23 user nova-compute[74582]:     </interface>
Nov 03 13:48:23 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:48:23 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/console.log" append="off"/>
Nov 03 13:48:23 user nova-compute[74582]:     </serial>
Nov 03 13:48:23 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:48:23 user nova-compute[74582]:     <video>
Nov 03 13:48:23 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:48:23 user nova-compute[74582]:     </video>
Nov 03 13:48:23 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:48:23 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:48:23 user nova-compute[74582]:     </rng>
Nov 03 13:48:23 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:48:23 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:48:23 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:48:23 user nova-compute[74582]:     </memballoon>
Nov 03 13:48:23 user nova-compute[74582]:   </devices>
Nov 03 13:48:23 user nova-compute[74582]: </domain>
Nov 03 13:48:23 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1858662947',display_name='tempest-TestVolumeSwap-server-1858662947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1858662947',id=9,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbS8Iq4oUyc0pw4rJxwDhlnU7/tD7moS83x7fS/WLocowPrk3HS86CmaELLuWDonXP0ql71IjmozEujQUf4tUSCqjH+Pys84uDXCJsHR2aduQQ7f1RgVEVoGeYVpzne2A==',key_name='tempest-keypair-1658946133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1371a42181fb4e61981eaf7680123707',ramdisk_id='',reservation_id='r-1a6cyjux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-230062966',owner_user_name='tempest-TestVolumeSwap-230062966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c51087d6b89d42e9890fcc9d4232e901',uuid=926114b3-1849-465b-94fb-3a1d6e49d56e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Converting VIF {"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG os_vif [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95c395d2-4a80-53a3-87ea-f82b1f768532', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc64e3520-64, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc64e3520-64, col_values=(('qos', UUID('1062de02-54cb-471e-84f3-5dadfe9fcfd9')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc64e3520-64, col_values=(('external_ids', {'iface-id': 'c64e3520-647a-4708-8765-bad6362ee795', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:42:13', 'vm-uuid': '926114b3-1849-465b-94fb-3a1d6e49d56e'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:23 user nova-compute[74582]: INFO os_vif [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64')
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] No VIF found with MAC fa:16:3e:bd:42:13, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.neutron [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updated VIF entry in instance network info cache for port c64e3520-647a-4708-8765-bad6362ee795. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG nova.network.neutron [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updating instance_info_cache with network_info: [{"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:48:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a28f0112-972d-46e1-b287-ee0228f7e218 req-9d4da791-d22c-4e30-9798-f52a3c381be6 service nova] Releasing lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:48:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-72a66ebd-61b7-417a-865f-b8484afd697f req-ea74ebb6-91e5-4771-8b07-0fb0348d4e23 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-72a66ebd-61b7-417a-865f-b8484afd697f req-ea74ebb6-91e5-4771-8b07-0fb0348d4e23 service nova] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-72a66ebd-61b7-417a-865f-b8484afd697f req-ea74ebb6-91e5-4771-8b07-0fb0348d4e23 service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-72a66ebd-61b7-417a-865f-b8484afd697f req-ea74ebb6-91e5-4771-8b07-0fb0348d4e23 service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-72a66ebd-61b7-417a-865f-b8484afd697f req-ea74ebb6-91e5-4771-8b07-0fb0348d4e23 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] No waiting events found dispatching network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:48:25 user nova-compute[74582]: WARNING nova.compute.manager [req-72a66ebd-61b7-417a-865f-b8484afd697f req-ea74ebb6-91e5-4771-8b07-0fb0348d4e23 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received unexpected event network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 for instance with vm_state building and task_state spawning.
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-9f06b60a-bba0-4cb3-a253-8be47e5d409e req-f6805cb5-4a1d-4f36-b0f6-3a4efbeb7349 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9f06b60a-bba0-4cb3-a253-8be47e5d409e req-f6805cb5-4a1d-4f36-b0f6-3a4efbeb7349 service nova] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9f06b60a-bba0-4cb3-a253-8be47e5d409e req-f6805cb5-4a1d-4f36-b0f6-3a4efbeb7349 service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9f06b60a-bba0-4cb3-a253-8be47e5d409e req-f6805cb5-4a1d-4f36-b0f6-3a4efbeb7349 service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-9f06b60a-bba0-4cb3-a253-8be47e5d409e req-f6805cb5-4a1d-4f36-b0f6-3a4efbeb7349 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] No waiting events found dispatching network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:48:27 user nova-compute[74582]: WARNING nova.compute.manager [req-9f06b60a-bba0-4cb3-a253-8be47e5d409e req-f6805cb5-4a1d-4f36-b0f6-3a4efbeb7349 service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received unexpected event network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 for instance with vm_state building and task_state spawning.
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:48:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Instance spawned successfully.
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:48:27 user nova-compute[74582]: INFO nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 03 13:48:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:48:27 user nova-compute[74582]: INFO nova.compute.manager [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Took 6.89 seconds to build instance.
Nov 03 13:48:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee2447c7-2a69-4e80-b52a-0bb528b73d84 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.022s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:48:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:48:37 user nova-compute[74582]: INFO nova.compute.claims [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Claim successful on node user
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:48:38 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG nova.policy [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '337fa0f2b5964789a76d2663c9f73f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6108f707190e46d7808a7c5ac5b1c2bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:48:38 user nova-compute[74582]: INFO nova.virt.block_device [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Booting with volume 97f5eb24-2bbe-41ee-afaf-2181e957bd36 at /dev/vda
Nov 03 13:48:38 user nova-compute[74582]: DEBUG os_brick.utils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:48:38 user nova-compute[74582]: INFO oslo.privsep.daemon [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjodg7ap8/privsep.sock']
Nov 03 13:48:38 user sudo[85687]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjodg7ap8/privsep.sock
Nov 03 13:48:38 user sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 13:48:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:48:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Successfully created port: ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Successfully updated port: ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquired lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-changed-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Refreshing instance network info cache due to event network-changed-ecbe0296-b0a8-497a-b256-3540a095f4a0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] Acquiring lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:48:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:48:40 user sudo[85687]: pam_unix(sudo:session): session closed for user root
Nov 03 13:48:40 user nova-compute[74582]: INFO oslo.privsep.daemon [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Spawned new privsep daemon via rootwrap
Nov 03 13:48:40 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 13:48:40 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 13:48:40 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 03 13:48:40 user nova-compute[74582]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85690
Nov 03 13:48:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updating instance_info_cache with network_info: [{"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Releasing lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance network_info: |[{"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] Acquired lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG nova.network.neutron [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Refreshing network info cache for port ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b6afc-d41a-417e-aab8-3395e02bc177]: (2,) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120e1c4-6e9f-4a97-9505-46a2906abb28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:48:40 user nova-compute[74582]: WARNING os_brick.initiator.connectors.nvmeof [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab807604-36cb-4d50-bff4-a95e2316d35d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec14bf-cd83-478d-9bd7-be11dcedb550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec15711-ae36-4aef-86cd-c9c96dc707dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:48:40 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c2940-8426-48dd-a75b-7f04e3b0e96f]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG os_brick.utils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] <== get_connector_properties: return (1996ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updating existing volume attachment record: a2b3ddbd-3ed2-4f86-b25a-c6b9f269443b {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG nova.network.neutron [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updated VIF entry in instance network info cache for port ecbe0296-b0a8-497a-b256-3540a095f4a0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG nova.network.neutron [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updating instance_info_cache with network_info: [{"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:48:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e0168f6a-fbfc-42c0-8711-797d01decb35 req-b6e932bb-b61d-4d76-806c-b6a24839b54a service nova] Releasing lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:48:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:48:44 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:48:49 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:48:49 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7196MB free_disk=25.606182098388672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 926114b3-1849-465b-94fb-3a1d6e49d56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:48:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:48:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:48:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:48:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:48:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:48:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updating instance_info_cache with network_info: [{"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:48:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:48:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:49:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "ddfed1ce-d154-45c4-932d-84804e020499" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:49:06 user nova-compute[74582]: INFO nova.compute.manager [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] instance snapshotting
Nov 03 13:49:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:06 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:49:06 user nova-compute[74582]: INFO nova.compute.claims [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Claim successful on node user
Nov 03 13:49:06 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Beginning live snapshot process
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:49:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.policy [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2790fcec7e2e4ad0b653e5d45c98372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625c2271dab47af9751af0bb23fcd64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:49:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Creating image(s)
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "/opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "/opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ni8iwvb/435a04b4f68e4f07a4178ad341569811.delta 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ni8iwvb/435a04b4f68e4f07a4178ad341569811.delta 1073741824" returned: 0 in 0.075s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 13:49:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74582) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 03 13:49:07 user nova-compute[74582]: INFO nova.virt.libvirt.host [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] UEFI support detected
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk 1073741824" returned: 0 in 0.046s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Successfully created port: 217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Cannot resize image /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Ensure instance console log exists: /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] COPY block job progress, current cursor: 458752 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:49:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] COPY block job progress, current cursor: 23592960 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:49:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:49:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 13:49:09 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:49:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ni8iwvb/435a04b4f68e4f07a4178ad341569811.delta /opt/stack/data/nova/instances/snapshots/tmp_ni8iwvb/435a04b4f68e4f07a4178ad341569811 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ni8iwvb/435a04b4f68e4f07a4178ad341569811.delta /opt/stack/data/nova/instances/snapshots/tmp_ni8iwvb/435a04b4f68e4f07a4178ad341569811" returned: 0 in 0.349s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:10 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Snapshot extracted, beginning image upload
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Successfully updated port: 217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "refresh_cache-ddfed1ce-d154-45c4-932d-84804e020499" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquired lock "refresh_cache-ddfed1ce-d154-45c4-932d-84804e020499" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-changed-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Refreshing instance network info cache due to event network-changed-217c21f8-125f-4f42-bea7-a3a0b54a681d. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] Acquiring lock "refresh_cache-ddfed1ce-d154-45c4-932d-84804e020499" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Updating instance_info_cache with network_info: [{"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Releasing lock "refresh_cache-ddfed1ce-d154-45c4-932d-84804e020499" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Instance network_info: |[{"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] Acquired lock "refresh_cache-ddfed1ce-d154-45c4-932d-84804e020499" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.neutron [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Refreshing network info cache for port 217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Start _get_guest_xml network_info=[{"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:49:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:49:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1132601184',display_name='tempest-ServersNegativeTestJSON-server-1132601184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1132601184',id=11,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1625c2271dab47af9751af0bb23fcd64',ramdisk_id='',reservation_id='r-20s58phw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-147568106',owner_user_name='tempest-ServersNegativeTestJSON-147568106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:49:08Z,user_data=None,user_id='2790fcec7e2e4ad0b653e5d45c98372e',uuid=ddfed1ce-d154-45c4-932d-84804e020499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converting VIF {"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lazy-loading 'pci_devices' on Instance uuid ddfed1ce-d154-45c4-932d-84804e020499 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:49:10 user nova-compute[74582]:   <uuid>ddfed1ce-d154-45c4-932d-84804e020499</uuid>
Nov 03 13:49:10 user nova-compute[74582]:   <name>instance-0000000b</name>
Nov 03 13:49:10 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:49:10 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:49:10 user nova-compute[74582]:   <metadata>
Nov 03 13:49:10 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:49:10 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:49:10 user nova-compute[74582]:       <nova:name>tempest-ServersNegativeTestJSON-server-1132601184</nova:name>
Nov 03 13:49:10 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:49:10</nova:creationTime>
Nov 03 13:49:10 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:49:10 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:49:10 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:49:10 user nova-compute[74582]:       <nova:owner>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:user uuid="2790fcec7e2e4ad0b653e5d45c98372e">tempest-ServersNegativeTestJSON-147568106-project-member</nova:user>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:project uuid="1625c2271dab47af9751af0bb23fcd64">tempest-ServersNegativeTestJSON-147568106</nova:project>
Nov 03 13:49:10 user nova-compute[74582]:       </nova:owner>
Nov 03 13:49:10 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:49:10 user nova-compute[74582]:       <nova:ports>
Nov 03 13:49:10 user nova-compute[74582]:         <nova:port uuid="217c21f8-125f-4f42-bea7-a3a0b54a681d">
Nov 03 13:49:10 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 13:49:10 user nova-compute[74582]:         </nova:port>
Nov 03 13:49:10 user nova-compute[74582]:       </nova:ports>
Nov 03 13:49:10 user nova-compute[74582]:     </nova:instance>
Nov 03 13:49:10 user nova-compute[74582]:   </metadata>
Nov 03 13:49:10 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:49:10 user nova-compute[74582]:     <system>
Nov 03 13:49:10 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:49:10 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:49:10 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:49:10 user nova-compute[74582]:       <entry name="serial">ddfed1ce-d154-45c4-932d-84804e020499</entry>
Nov 03 13:49:10 user nova-compute[74582]:       <entry name="uuid">ddfed1ce-d154-45c4-932d-84804e020499</entry>
Nov 03 13:49:10 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:49:10 user nova-compute[74582]:     </system>
Nov 03 13:49:10 user nova-compute[74582]:   </sysinfo>
Nov 03 13:49:10 user nova-compute[74582]:   <os>
Nov 03 13:49:10 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:49:10 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:49:10 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:49:10 user nova-compute[74582]:   </os>
Nov 03 13:49:10 user nova-compute[74582]:   <features>
Nov 03 13:49:10 user nova-compute[74582]:     <acpi/>
Nov 03 13:49:10 user nova-compute[74582]:     <apic/>
Nov 03 13:49:10 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:49:10 user nova-compute[74582]:   </features>
Nov 03 13:49:10 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:49:10 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:49:10 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:49:10 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:49:10 user nova-compute[74582]:   </clock>
Nov 03 13:49:10 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:49:10 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:49:10 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:49:10 user nova-compute[74582]:   </cpu>
Nov 03 13:49:10 user nova-compute[74582]:   <devices>
Nov 03 13:49:10 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:49:10 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:49:10 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk"/>
Nov 03 13:49:10 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:49:10 user nova-compute[74582]:     </disk>
Nov 03 13:49:10 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:49:10 user nova-compute[74582]:       <mac address="fa:16:3e:9d:ee:fc"/>
Nov 03 13:49:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:49:10 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:49:10 user nova-compute[74582]:       <target dev="tap217c21f8-12"/>
Nov 03 13:49:10 user nova-compute[74582]:     </interface>
Nov 03 13:49:10 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:49:10 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/console.log" append="off"/>
Nov 03 13:49:10 user nova-compute[74582]:     </serial>
Nov 03 13:49:10 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:49:10 user nova-compute[74582]:     <video>
Nov 03 13:49:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:49:10 user nova-compute[74582]:     </video>
Nov 03 13:49:10 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:49:10 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:49:10 user nova-compute[74582]:     </rng>
Nov 03 13:49:10 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:49:10 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:49:10 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:49:10 user nova-compute[74582]:     </memballoon>
Nov 03 13:49:10 user nova-compute[74582]:   </devices>
Nov 03 13:49:10 user nova-compute[74582]: </domain>
Nov 03 13:49:10 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1132601184',display_name='tempest-ServersNegativeTestJSON-server-1132601184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1132601184',id=11,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1625c2271dab47af9751af0bb23fcd64',ramdisk_id='',reservation_id='r-20s58phw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-147568106',owner_user_name='tempest-ServersNegativeTestJSON-147568106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:49:08Z,user_data=None,user_id='2790fcec7e2e4ad0b653e5d45c98372e',uuid=ddfed1ce-d154-45c4-932d-84804e020499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converting VIF {"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG os_vif [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f869a2a-2a86-5eaa-8f56-361f5b4bca9c', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217c21f8-12, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap217c21f8-12, col_values=(('qos', UUID('97e71658-0fe9-42c4-945f-5e86a1ff85f1')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap217c21f8-12, col_values=(('external_ids', {'iface-id': '217c21f8-125f-4f42-bea7-a3a0b54a681d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:ee:fc', 'vm-uuid': 'ddfed1ce-d154-45c4-932d-84804e020499'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:10 user nova-compute[74582]: INFO os_vif [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12')
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:49:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] No VIF found with MAC fa:16:3e:9d:ee:fc, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-changed-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Refreshing instance network info cache due to event network-changed-7dc85b5b-09fc-488a-814e-40dc04da5ec2. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] Acquiring lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] Acquired lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Refreshing network info cache for port 7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-changed-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Refreshing instance network info cache due to event network-changed-c71933a3-2c2b-4986-9d51-f3f1c8978bc5. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] Acquiring lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] Acquired lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Refreshing network info cache for port c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Updated VIF entry in instance network info cache for port 217c21f8-125f-4f42-bea7-a3a0b54a681d. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Updating instance_info_cache with network_info: [{"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7874cc9d-a884-44b2-9e43-34c10f29c3ca req-302dab72-c9c6-43db-b0b1-dd94496be6a8 service nova] Releasing lock "refresh_cache-ddfed1ce-d154-45c4-932d-84804e020499" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updated VIF entry in instance network info cache for port c71933a3-2c2b-4986-9d51-f3f1c8978bc5. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating instance_info_cache with network_info: [{"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-30e4128d-2830-449f-9a36-a381bc0044c2 req-fa9e45ba-2a21-4792-9575-03ebd1b47ad5 service nova] Releasing lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updated VIF entry in instance network info cache for port 7dc85b5b-09fc-488a-814e-40dc04da5ec2. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9375f840-d296-4199-931c-7c4be9311a1d req-7d5165db-0496-4779-ac17-5647f7d4aec2 service nova] Releasing lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-changed-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Refreshing instance network info cache due to event network-changed-2b20a9c0-1c23-4a40-96fc-722cb901bf56. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Refreshing network info cache for port 2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updated VIF entry in instance network info cache for port 2b20a9c0-1c23-4a40-96fc-722cb901bf56. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-62e07338-45b4-4705-890c-b7fda85d4066 req-f2fb9987-6d96-4d62-8def-b78f83d174d0 service nova] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:49:13 user nova-compute[74582]: WARNING nova.compute.manager [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state building and task_state spawning.
Nov 03 13:49:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:49:13 user nova-compute[74582]: WARNING nova.compute.manager [req-e82b1aa5-7053-4da8-8945-8ec62d5621f1 req-6de9f2ce-0ae9-40d4-bcdc-78c4e9caa6da service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state building and task_state spawning.
Nov 03 13:49:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Snapshot image upload complete
Nov 03 13:49:13 user nova-compute[74582]: INFO nova.compute.manager [None req-47b118f7-be25-487f-b904-1255f68304d1 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Took 7.10 seconds to snapshot the instance on the hypervisor.
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:49:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Instance spawned successfully.
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:14 user nova-compute[74582]: INFO nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 03 13:49:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:49:15 user nova-compute[74582]: INFO nova.compute.manager [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Took 8.31 seconds to build instance.
Nov 03 13:49:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1ffcfb2-012b-4dec-9779-0fbd3790ba67 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "ddfed1ce-d154-45c4-932d-84804e020499" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.438s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:49:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Creating image(s)
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Ensure instance console log exists: /opt/stack/data/nova/instances/01985e3c-5b20-4701-99c7-d374f5a2d76d/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Start _get_guest_xml network_info=[{"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a2b3ddbd-3ed2-4f86-b25a-c6b9f269443b', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDwhiMCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01985e3c-5b20-4701-99c7-d374f5a2d76d', 'attached_at': '', 'detached_at': '', 'volume_id': '97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'serial': '97f5eb24-2bbe-41ee-afaf-2181e957bd36'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:49:15 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:49:15 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connector [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Factory for ISCSI on None {{(pid=74582) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDwhiMCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:16 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:49:16 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:49:16 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[146ed13d-ae74-4452-918e-eedf6cac1dc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:49:16 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28ce6f1-fce9-4fb0-934b-26f274b80164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36] added
Nov 03 13:49:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c612364c-c8f5-487d-a5ae-356f3b930bdf]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d1d1e7-1231-4fbd-ab06-a7d7e273132a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDwhiMCu {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDwhiMCu" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9ddc63-29c4-4106-915b-bee2d78a9a42]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EDwhiMCu'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666710b-1d47-43ee-bb7e-48b2753fee5e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b344e26-0dfe-4e97-844d-6e7efc6d8a87]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 13:49:16 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 13:49:16 user nova-compute[74582]:  {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:49:16 user nova-compute[74582]: WARNING os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 13:49:16 user nova-compute[74582]: 
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce564d-32c1-4940-b3f1-17a3ca2181c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260]
Nov 03 13:49:16 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260] successful.
Nov 03 13:49:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0cc17f-7223-4040-8b43-971ca012f9fc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e52b86-2c8d-4c0b-9a9e-d7a3433c66d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed64882-ec98-4090-be9a-75c2fd940542]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:49:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDwhiMCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26435323365653665', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323365653665', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-241734421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-241734421',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0Z3EAdEMgKPBJmHJky1vcmcINe+C3ixOHfIGjUzaCZAJW6x21cpktz5sjhOxSWyL0+kP774Jlq+c74EGE/G/pLJyvCvugq+X8qBcYiboqtZNXzbto+ZRWAVuUbWiBBtg==',key_name='tempest-keypair-1401802885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6108f707190e46d7808a7c5ac5b1c2bf',ramdisk_id='',reservation_id='r-6ncqv720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1647953654',owner_user_name='tempest-ServerActionsV293TestJSON-1647953654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='337fa0f2b5964789a76d2663c9f73f1c',uuid=01985e3c-5b20-4701-99c7-d374f5a2d76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converting VIF {"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lazy-loading 'pci_devices' on Instance uuid 01985e3c-5b20-4701-99c7-d374f5a2d76d {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:49:17 user nova-compute[74582]:   <uuid>01985e3c-5b20-4701-99c7-d374f5a2d76d</uuid>
Nov 03 13:49:17 user nova-compute[74582]:   <name>instance-0000000a</name>
Nov 03 13:49:17 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:49:17 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:49:17 user nova-compute[74582]:   <metadata>
Nov 03 13:49:17 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:49:17 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:49:17 user nova-compute[74582]:       <nova:name>tempest-ServerActionsV293TestJSON-server-241734421</nova:name>
Nov 03 13:49:17 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:49:15</nova:creationTime>
Nov 03 13:49:17 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:49:17 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:49:17 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:49:17 user nova-compute[74582]:       <nova:owner>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:user uuid="337fa0f2b5964789a76d2663c9f73f1c">tempest-ServerActionsV293TestJSON-1647953654-project-member</nova:user>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:project uuid="6108f707190e46d7808a7c5ac5b1c2bf">tempest-ServerActionsV293TestJSON-1647953654</nova:project>
Nov 03 13:49:17 user nova-compute[74582]:       </nova:owner>
Nov 03 13:49:17 user nova-compute[74582]:       <nova:ports>
Nov 03 13:49:17 user nova-compute[74582]:         <nova:port uuid="ecbe0296-b0a8-497a-b256-3540a095f4a0">
Nov 03 13:49:17 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 13:49:17 user nova-compute[74582]:         </nova:port>
Nov 03 13:49:17 user nova-compute[74582]:       </nova:ports>
Nov 03 13:49:17 user nova-compute[74582]:     </nova:instance>
Nov 03 13:49:17 user nova-compute[74582]:   </metadata>
Nov 03 13:49:17 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:49:17 user nova-compute[74582]:     <system>
Nov 03 13:49:17 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:49:17 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:49:17 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:49:17 user nova-compute[74582]:       <entry name="serial">01985e3c-5b20-4701-99c7-d374f5a2d76d</entry>
Nov 03 13:49:17 user nova-compute[74582]:       <entry name="uuid">01985e3c-5b20-4701-99c7-d374f5a2d76d</entry>
Nov 03 13:49:17 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:49:17 user nova-compute[74582]:     </system>
Nov 03 13:49:17 user nova-compute[74582]:   </sysinfo>
Nov 03 13:49:17 user nova-compute[74582]:   <os>
Nov 03 13:49:17 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:49:17 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:49:17 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:49:17 user nova-compute[74582]:   </os>
Nov 03 13:49:17 user nova-compute[74582]:   <features>
Nov 03 13:49:17 user nova-compute[74582]:     <acpi/>
Nov 03 13:49:17 user nova-compute[74582]:     <apic/>
Nov 03 13:49:17 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:49:17 user nova-compute[74582]:   </features>
Nov 03 13:49:17 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:49:17 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:49:17 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:49:17 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:49:17 user nova-compute[74582]:   </clock>
Nov 03 13:49:17 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:49:17 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:49:17 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:49:17 user nova-compute[74582]:   </cpu>
Nov 03 13:49:17 user nova-compute[74582]:   <devices>
Nov 03 13:49:17 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 13:49:17 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:49:17 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 13:49:17 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:49:17 user nova-compute[74582]:       <serial>97f5eb24-2bbe-41ee-afaf-2181e957bd36</serial>
Nov 03 13:49:17 user nova-compute[74582]:     </disk>
Nov 03 13:49:17 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:49:17 user nova-compute[74582]:       <mac address="fa:16:3e:28:5d:1f"/>
Nov 03 13:49:17 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:49:17 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:49:17 user nova-compute[74582]:       <target dev="tapecbe0296-b0"/>
Nov 03 13:49:17 user nova-compute[74582]:     </interface>
Nov 03 13:49:17 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:49:17 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/01985e3c-5b20-4701-99c7-d374f5a2d76d/console.log" append="off"/>
Nov 03 13:49:17 user nova-compute[74582]:     </serial>
Nov 03 13:49:17 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:49:17 user nova-compute[74582]:     <video>
Nov 03 13:49:17 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:49:17 user nova-compute[74582]:     </video>
Nov 03 13:49:17 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:49:17 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:49:17 user nova-compute[74582]:     </rng>
Nov 03 13:49:17 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:49:17 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:49:17 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:49:17 user nova-compute[74582]:     </memballoon>
Nov 03 13:49:17 user nova-compute[74582]:   </devices>
Nov 03 13:49:17 user nova-compute[74582]: </domain>
Nov 03 13:49:17 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-241734421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-241734421',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0Z3EAdEMgKPBJmHJky1vcmcINe+C3ixOHfIGjUzaCZAJW6x21cpktz5sjhOxSWyL0+kP774Jlq+c74EGE/G/pLJyvCvugq+X8qBcYiboqtZNXzbto+ZRWAVuUbWiBBtg==',key_name='tempest-keypair-1401802885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6108f707190e46d7808a7c5ac5b1c2bf',ramdisk_id='',reservation_id='r-6ncqv720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1647953654',owner_user_name='tempest-ServerActionsV293TestJSON-1647953654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='337fa0f2b5964789a76d2663c9f73f1c',uuid=01985e3c-5b20-4701-99c7-d374f5a2d76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converting VIF {"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG os_vif [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91775233-e2a7-5210-a2e5-9e9fa51c0462', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecbe0296-b0, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecbe0296-b0, col_values=(('qos', UUID('208e1483-26f2-43cd-8844-ac710f1ed4d5')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecbe0296-b0, col_values=(('external_ids', {'iface-id': 'ecbe0296-b0a8-497a-b256-3540a095f4a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:5d:1f', 'vm-uuid': '01985e3c-5b20-4701-99c7-d374f5a2d76d'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:17 user nova-compute[74582]: INFO os_vif [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0')
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] No VIF found with MAC fa:16:3e:28:5d:1f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG nova.objects.instance [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:18 user nova-compute[74582]: INFO nova.compute.manager [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Attaching volume 7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 to /dev/vdb
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:18 user nova-compute[74582]: INFO nova.compute.manager [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Attaching volume 89a157de-3dd0-4dcb-8a42-f49d19ec2712 to /dev/vdb
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.utils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.utils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb3def2-a861-4ae5-897a-bc6a86502306]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adee2ed-2919-4996-840a-f5440abfffbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[776aceda-12a3-4c12-b1de-ad134d520a0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f4194-ec72-45bf-81b1-761a64092143]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb493d-3c3c-4c43-8452-41c4cd7d848e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f9ec1-b41b-4c19-afad-275859961330]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8424514-74ab-4e90-9d4d-52cf7269961d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a1fac-4dc1-42b6-b007-1409ed505a2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:18 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[169fa3d1-ccae-46c3-9fca-8d9d5df46ff9]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:18 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:49:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b5b86-ac4f-4b64-a49d-d8fb459e8288]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.utils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating existing volume attachment record: b53d0fc9-108c-46ab-b9d0-eb700beef32b {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG os_brick.utils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== get_connector_properties: return (234ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:18 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating existing volume attachment record: d5e50450-67c2-4f00-98dd-e40f48c3d8be {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG nova.compute.manager [req-5fda2283-960d-4a45-966d-e38f3b502f22 req-ecfcd5de-ca56-4b5b-972b-95688d1af25a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5fda2283-960d-4a45-966d-e38f3b502f22 req-ecfcd5de-ca56-4b5b-972b-95688d1af25a service nova] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5fda2283-960d-4a45-966d-e38f3b502f22 req-ecfcd5de-ca56-4b5b-972b-95688d1af25a service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5fda2283-960d-4a45-966d-e38f3b502f22 req-ecfcd5de-ca56-4b5b-972b-95688d1af25a service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG nova.compute.manager [req-5fda2283-960d-4a45-966d-e38f3b502f22 req-ecfcd5de-ca56-4b5b-972b-95688d1af25a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] No waiting events found dispatching network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:49:19 user nova-compute[74582]: WARNING nova.compute.manager [req-5fda2283-960d-4a45-966d-e38f3b502f22 req-ecfcd5de-ca56-4b5b-972b-95688d1af25a service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received unexpected event network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 for instance with vm_state building and task_state spawning.
Nov 03 13:49:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:20 user nova-compute[74582]: INFO nova.compute.manager [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Shelving
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-16adf071-efce-4278-ac7a-9619f5b0903e req-5f767949-89e7-4d9f-b67f-7dc887bf5750 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-unplugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-16adf071-efce-4278-ac7a-9619f5b0903e req-5f767949-89e7-4d9f-b67f-7dc887bf5750 service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-16adf071-efce-4278-ac7a-9619f5b0903e req-5f767949-89e7-4d9f-b67f-7dc887bf5750 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-16adf071-efce-4278-ac7a-9619f5b0903e req-5f767949-89e7-4d9f-b67f-7dc887bf5750 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-16adf071-efce-4278-ac7a-9619f5b0903e req-5f767949-89e7-4d9f-b67f-7dc887bf5750 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-unplugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:49:20 user nova-compute[74582]: WARNING nova.compute.manager [req-16adf071-efce-4278-ac7a-9619f5b0903e req-5f767949-89e7-4d9f-b67f-7dc887bf5750 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-unplugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state active and task_state shelving.
Nov 03 13:49:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance destroyed successfully.
Nov 03 13:49:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Beginning cold snapshot process
Nov 03 13:49:21 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk /opt/stack/data/nova/instances/snapshots/tmpc6aloppx/d639916ea6da4da589acdc17fc461066 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-0a7e54ae-f605-4c4f-b2ea-89b3b87237e3 req-205b174f-06d1-491f-a9ac-c4b96ca4cab2 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0a7e54ae-f605-4c4f-b2ea-89b3b87237e3 req-205b174f-06d1-491f-a9ac-c4b96ca4cab2 service nova] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0a7e54ae-f605-4c4f-b2ea-89b3b87237e3 req-205b174f-06d1-491f-a9ac-c4b96ca4cab2 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0a7e54ae-f605-4c4f-b2ea-89b3b87237e3 req-205b174f-06d1-491f-a9ac-c4b96ca4cab2 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-0a7e54ae-f605-4c4f-b2ea-89b3b87237e3 req-205b174f-06d1-491f-a9ac-c4b96ca4cab2 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] No waiting events found dispatching network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:49:21 user nova-compute[74582]: WARNING nova.compute.manager [req-0a7e54ae-f605-4c4f-b2ea-89b3b87237e3 req-205b174f-06d1-491f-a9ac-c4b96ca4cab2 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received unexpected event network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 for instance with vm_state building and task_state spawning.
Nov 03 13:49:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk /opt/stack/data/nova/instances/snapshots/tmpc6aloppx/d639916ea6da4da589acdc17fc461066" returned: 0 in 0.758s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:21 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Snapshot extracted, beginning image upload
Nov 03 13:49:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:49:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:49:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance spawned successfully.
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:49:22 user nova-compute[74582]: INFO nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:49:22 user nova-compute[74582]: INFO nova.compute.manager [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Took 44.70 seconds to build instance.
Nov 03 13:49:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4608a52d-16ef-4fda-987f-5721f1e5101b tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.819s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-e2e29554-f02f-4e71-9be4-100eebeb126b req-eb92aa56-5892-4751-82a5-60e274f401bf service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e2e29554-f02f-4e71-9be4-100eebeb126b req-eb92aa56-5892-4751-82a5-60e274f401bf service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e2e29554-f02f-4e71-9be4-100eebeb126b req-eb92aa56-5892-4751-82a5-60e274f401bf service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e2e29554-f02f-4e71-9be4-100eebeb126b req-eb92aa56-5892-4751-82a5-60e274f401bf service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-e2e29554-f02f-4e71-9be4-100eebeb126b req-eb92aa56-5892-4751-82a5-60e274f401bf service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:49:22 user nova-compute[74582]: WARNING nova.compute.manager [req-e2e29554-f02f-4e71-9be4-100eebeb126b req-eb92aa56-5892-4751-82a5-60e274f401bf service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 13:49:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Snapshot image upload complete
Nov 03 13:49:25 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:49:25 user nova-compute[74582]: INFO nova.compute.manager [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Shelve offloading
Nov 03 13:49:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance destroyed successfully.
Nov 03 13:49:25 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:49:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquired lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-changed-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Refreshing instance network info cache due to event network-changed-4a75e92f-dc5c-434a-a705-c539a673e831. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] Acquiring lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] Acquired lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG nova.network.neutron [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Refreshing network info cache for port 4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Releasing lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updated VIF entry in instance network info cache for port 4a75e92f-dc5c-434a-a705-c539a673e831. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating instance_info_cache with network_info: [{"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-de4f49c3-b3b8-4610-9093-30cc0302b28f req-ee64351d-8e68-458a-a788-85d29ce6c52e service nova] Releasing lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance destroyed successfully.
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'resources' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-181316597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-181316597',id=4,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnB/utDpecLLpWTUtILHBV1NT6pvDqpn6zX57hWvTkoWDFBCkRrcegZ5fujd6+b+W18bsggPi4c5/PT7Uit2jBo0X0tGzu8GzEJ+mCoiR4yaoe2rXdTIb7RW+HfQQbKGQ==',key_name='tempest-keypair-810171847',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-i93tzi7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member',shelved_at='2023-11-03T13:49:25.590933',shelved_host='user',shelved_image_id='8064c43d-cd05-43a5-8fae-e412952a6122'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=e6a282d9-0ea3-431e-8df4-ffe5d8ae6823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG os_vif [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dc85b5b-09, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c07ada8-ab1f-4601-bd0a-e2a0aaf82d38) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:49:27 user nova-compute[74582]: INFO os_vif [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09')
Nov 03 13:49:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Deleting instance files /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823_del
Nov 03 13:49:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Deletion of /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823_del complete
Nov 03 13:49:27 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Deleted allocations for instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823
Nov 03 13:49:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'numa_topology' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.objects.base [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<e6a282d9-0ea3-431e-8df4-ffe5d8ae6823> lazy-loaded attributes: resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:49:27 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:49:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a060e185-5bde-4b78-90d8-23f5b34b4abf tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.074s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-changed-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Refreshing instance network info cache due to event network-changed-b54551bb-7df9-45cf-b125-75f48e263d65. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] Acquiring lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] Acquired lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:30 user nova-compute[74582]: DEBUG nova.network.neutron [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Refreshing network info cache for port b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:31 user nova-compute[74582]: DEBUG nova.network.neutron [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updated VIF entry in instance network info cache for port b54551bb-7df9-45cf-b125-75f48e263d65. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:31 user nova-compute[74582]: DEBUG nova.network.neutron [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updating instance_info_cache with network_info: [{"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-421887eb-b74c-4def-b5fa-060cf0bdafab req-88d27186-9ed3-414b-bec3-cb23685da6cf service nova] Releasing lock "refresh_cache-a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:34 user nova-compute[74582]: DEBUG nova.objects.instance [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'flavor' on Instance uuid 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:34 user nova-compute[74582]: INFO nova.compute.manager [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Attaching volume 6c00e173-2810-4912-9b60-4d9202a3712d to /dev/vdb
Nov 03 13:49:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8848e1d0-59f4-48f6-a8d2-8a40c43f4c52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbff4260-b957-439c-bab1-f60d2fc6f88a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1af83c-a1a7-40a2-8579-810c876cafd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac47f96-e8e0-4430-8727-b969399c7d10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:35 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:49:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[605c24ce-90e9-45bf-b749-c5920ef9d0de]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating existing volume attachment record: 1881a2a3-d34a-4e36-a679-7e63a7187d82 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:49:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:49:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYpsbBmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:42 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:49:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:49:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:49:42 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:49:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:49:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:49:42 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:49:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeac99df-3edc-448d-921f-911bc490243b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:49:43 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1244fc-97d7-43da-b96c-4a73aa5b3a34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712] added
Nov 03 13:49:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fe6804-43ea-4a58-9320-a8648b3bdd72]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a81bd-dcf2-4f44-81b8-4d8eba8fae4b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FYpsbBmP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FYpsbBmP" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e96fc9-341f-4b80-8184-56d00b72ac15]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FYpsbBmP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1ec1c5-cf32-4771-8b2d-6bb06d29f74b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:43 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde88aa4-acc2-443f-9f76-864a034404a0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c09317-26f1-464e-b31f-0f3e40c84d4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260]
Nov 03 13:49:43 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260] successful.
Nov 03 13:49:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5042d9c8-22e0-4870-be34-748743af283c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b49acd6-46e6-473f-a284-7601f966b016]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:43 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:49:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:43 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:49:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f41d5-de4d-4703-a82a-f3450d63bae9]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYpsbBmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lazy-loading 'flavor' on Instance uuid a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:43 user nova-compute[74582]: INFO nova.compute.manager [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Attaching volume 2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 to /dev/sdc
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.utils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eccce1-a3d0-4dca-8200-5ce3e539e0f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c04b0e-cc59-4657-96b0-009b1cc96357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ac8042-20b2-4147-b01a-beb958b14ee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b5b24-5b3b-4a3a-ab98-0dc0f83d1ef0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:43 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:49:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[396cef39-62ad-40d2-9e50-4e9fe901439b]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG os_brick.utils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:43 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updating existing volume attachment record: ca5d5079-31f8-43f8-9680-bbc9faf76b8f {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-changed-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Refreshing instance network info cache due to event network-changed-042a8bde-8189-485c-90da-de4b304c57ac. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] Acquiring lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] Acquired lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Refreshing network info cache for port 042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26663356439666538', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663356439666538', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.189s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:49:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:49:44 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f4dcf7-bcdc-44b3-be7d-6a962582d36f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:49:44 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:49:44 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:49:44 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:49:44 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:49:44 user nova-compute[74582]:   <serial>89a157de-3dd0-4dcb-8a42-f49d19ec2712</serial>
Nov 03 13:49:44 user nova-compute[74582]: </disk>
Nov 03 13:49:44 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[101baa51-e054-487c-9ab1-255eb0d3e17b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9] added
Nov 03 13:49:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef89865-89ff-4756-af52-f3b323c239c4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eae374-01ab-4234-96a9-6cef05d62ab9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdckBawx {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lazy-loading 'flavor' on Instance uuid a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdckBawx" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ff322-46c1-46a8-ad19-1c0fd9e60c46]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdckBawx'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1270bb2-d7f8-4759-a51a-82b32ce2df20]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f754f395-9096-426f-a361-eebf6790627d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3d801-0cc0-4d7d-9e91-a4a105831434]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]
Nov 03 13:49:44 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.
Nov 03 13:49:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4978e93-bbfc-4f28-9bd0-b70001de2187]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f93d79-f51b-472c-b3e0-5f98092ff1d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:49:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d98564-0872-40e2-8e89-444f0c3f24b5]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:44 user nova-compute[74582]: INFO nova.compute.manager [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Attaching volume a88c0b68-0565-449f-bd09-8d7c23821ed4 to /dev/vdb
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updated VIF entry in instance network info cache for port 042a8bde-8189-485c-90da-de4b304c57ac. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:49:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updating instance_info_cache with network_info: [{"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0cad105e-2a02-4b3c-9164-2d230be4c641 req-b109141c-b485-4253-8281-cba780ebce18 service nova] Releasing lock "refresh_cache-a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:f7:59:3e, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.utils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746d1e3-ee38-4a4a-8af5-d3cdc3b065db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5b2daa-49a8-4f7f-8e7f-61b67751f494]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[069788dc-f3a3-40a2-9040-4627ba0f2823]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f7804e-a877-41af-8bb2-fa6e9e896e78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:49:45 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e06111-5911-4ac0-b657-dc1a2aecbf25]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ac0aaf31-6b6f-4388-a71f-f3b268455861 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.854s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.utils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updating existing volume attachment record: 04b39604-8ca6-4871-83f3-662a2f6d282a {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== connect_volume: return (2605ms) {'type': 'block', 'scsi_wwn': '26661383938336161', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383938336161', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:49:45 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:49:45 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:49:45 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:49:45 user nova-compute[74582]:   <serial>7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9</serial>
Nov 03 13:49:45 user nova-compute[74582]: </disk>
Nov 03 13:49:45 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No VIF found with MAC fa:16:3e:75:8e:a5, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:49:49 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:49:49 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7089MB free_disk=25.501144409179688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 926114b3-1849-465b-94fb-3a1d6e49d56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ddfed1ce-d154-45c4-932d-84804e020499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:49:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:49:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:49:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:49:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:49:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:49:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:49:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:49:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:49:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:49:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:49:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHtZazeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:05 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:05 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:05 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[27128e18-9345-49e7-abd5-e532840aade8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:50:05 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e7915-6bc6-44a6-9dce-fee0ab4fe82e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6] added
Nov 03 13:50:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1300aa68-0fac-481c-b30d-4d283cfea5d9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[418fdf6d-12a0-4a21-b828-7e2001b2f4bf]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FHtZazeK {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FHtZazeK" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfad518-a4a5-49ae-a9bc-f1918176a2c8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FHtZazeK'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce96f224-6ee9-4308-bf77-2c9cce2e1547]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7516ba-eea6-40c3-9156-70aa9461a39f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f8d46-675b-4930-a6ef-f4a65ce0012d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260]
Nov 03 13:50:05 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88539419-e1fb-4f6e-ba5a-8bfa716f36df]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566fa20-0b9a-46a3-91d7-b28b3c98e55d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05a140-d140-436e-8153-50d5d0d93ed4]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHtZazeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:50:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34556dd0-3dd9-452d-a819-e4ca67650821 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.140s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74582) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23762393161343838', 'path': '/dev/sde'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762393161343838', 'path': '/dev/sde'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lazy-loading 'flavor' on Instance uuid a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:50:06 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:06 user nova-compute[74582]:   <source dev="/dev/sde"/>
Nov 03 13:50:06 user nova-compute[74582]:   <target dev="sdc" bus="scsi"/>
Nov 03 13:50:06 user nova-compute[74582]:   <serial>2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6</serial>
Nov 03 13:50:06 user nova-compute[74582]:   <address type="drive" controller="0" unit="2"/>
Nov 03 13:50:06 user nova-compute[74582]: </disk>
Nov 03 13:50:06 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-812eab8b-cfc6-4864-811c-52c9966dedbe req-db0e4054-a19c-4a71-89a2-c5e02bded98f service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-812eab8b-cfc6-4864-811c-52c9966dedbe req-db0e4054-a19c-4a71-89a2-c5e02bded98f service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-812eab8b-cfc6-4864-811c-52c9966dedbe req-db0e4054-a19c-4a71-89a2-c5e02bded98f service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-812eab8b-cfc6-4864-811c-52c9966dedbe req-db0e4054-a19c-4a71-89a2-c5e02bded98f service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-812eab8b-cfc6-4864-811c-52c9966dedbe req-db0e4054-a19c-4a71-89a2-c5e02bded98f service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:06 user nova-compute[74582]: WARNING nova.compute.manager [req-812eab8b-cfc6-4864-811c-52c9966dedbe req-db0e4054-a19c-4a71-89a2-c5e02bded98f service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state active and task_state powering-off.
Nov 03 13:50:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No BDM found with device name sda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] No VIF found with MAC fa:16:3e:c2:83:56, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:50:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e111a216-7ed6-4eb9-a78c-fed76b503fca tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.624s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance destroyed successfully.
Nov 03 13:50:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:50:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6f63c229-a8a9-4083-b57b-f56b932661f5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:08 user nova-compute[74582]: INFO nova.compute.manager [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Detaching volume 2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6
Nov 03 13:50:08 user nova-compute[74582]: INFO nova.virt.block_device [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Attempting to driver detach volume 2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 from mountpoint /dev/sdc
Nov 03 13:50:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Attempting to detach device sdc from instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:50:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:50:08 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:08 user nova-compute[74582]:   <source dev="/dev/sde"/>
Nov 03 13:50:08 user nova-compute[74582]:   <target dev="sdc" bus="scsi"/>
Nov 03 13:50:08 user nova-compute[74582]:   <serial>2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6</serial>
Nov 03 13:50:08 user nova-compute[74582]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 13:50:08 user nova-compute[74582]: </disk>
Nov 03 13:50:08 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:50:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Successfully detached device sdc from instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 from the persistent domain config.
Nov 03 13:50:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:50:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:50:08 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:08 user nova-compute[74582]:   <source dev="/dev/sde"/>
Nov 03 13:50:08 user nova-compute[74582]:   <target dev="sdc" bus="scsi"/>
Nov 03 13:50:08 user nova-compute[74582]:   <serial>2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6</serial>
Nov 03 13:50:08 user nova-compute[74582]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 13:50:08 user nova-compute[74582]: </disk>
Nov 03 13:50:08 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:50:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG nova.compute.manager [req-5bd45f3e-d160-4a39-a356-c163175b8764 req-efe64439-6af8-422f-a5b6-298e5eb52dc5 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5bd45f3e-d160-4a39-a356-c163175b8764 req-efe64439-6af8-422f-a5b6-298e5eb52dc5 service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5bd45f3e-d160-4a39-a356-c163175b8764 req-efe64439-6af8-422f-a5b6-298e5eb52dc5 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5bd45f3e-d160-4a39-a356-c163175b8764 req-efe64439-6af8-422f-a5b6-298e5eb52dc5 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG nova.compute.manager [req-5bd45f3e-d160-4a39-a356-c163175b8764 req-efe64439-6af8-422f-a5b6-298e5eb52dc5 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:09 user nova-compute[74582]: WARNING nova.compute.manager [req-5bd45f3e-d160-4a39-a356-c163175b8764 req-efe64439-6af8-422f-a5b6-298e5eb52dc5 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state stopped and task_state None.
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:09 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:50:09 user nova-compute[74582]: INFO nova.compute.claims [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Claim successful on node user
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:50:10 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.policy [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f64445061a214d13992b8b3bbacfb0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd438a60c19854c4a93593908fb9b4390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:50:10 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Creating image(s)
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk 1073741824" returned: 0 in 0.047s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Successfully created port: 69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Cannot resize image /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Ensure instance console log exists: /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Successfully updated port: 69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquired lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-changed-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Refreshing instance network info cache due to event network-changed-c64e3520-647a-4708-8765-bad6362ee795. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] Acquiring lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] Acquired lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Refreshing network info cache for port c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-changed-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Refreshing instance network info cache due to event network-changed-69a43c35-3a4e-4316-91dd-061c62542fb8. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] Acquiring lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.objects.instance [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lazy-loading 'flavor' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Updating instance_info_cache with network_info: [{"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Releasing lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Instance network_info: |[{"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] Acquired lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Refreshing network info cache for port 69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Start _get_guest_xml network_info=[{"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updated VIF entry in instance network info cache for port c64e3520-647a-4708-8765-bad6362ee795. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updating instance_info_cache with network_info: [{"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:50:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c814325b-5e3d-4817-aa82-0fd49ba8662f req-b50bd3e8-2f92-498a-9569-f50573bd024d service nova] Releasing lock "refresh_cache-926114b3-1849-465b-94fb-3a1d6e49d56e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1963385228',display_name='tempest-AttachVolumeNegativeTest-server-1963385228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1963385228',id=12,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa3xP7/sxvwxS9UvK3LGvqgSVMT6MBKIi5YereHLVNp2dXY1b8Sgr9KnUMD59onTk4kA5haNgVLKbk+n+X19m5thLjSaNYsnU7PL15yWWipfHuzlmp33g3I5RMCC/6m4g==',key_name='tempest-keypair-666006040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-1bc580p8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=b9636f0f-472d-40f5-bb99-3c11296ba1c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'pci_devices' on Instance uuid b9636f0f-472d-40f5-bb99-3c11296ba1c5 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:50:12 user nova-compute[74582]:   <uuid>b9636f0f-472d-40f5-bb99-3c11296ba1c5</uuid>
Nov 03 13:50:12 user nova-compute[74582]:   <name>instance-0000000c</name>
Nov 03 13:50:12 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:50:12 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:50:12 user nova-compute[74582]:   <metadata>
Nov 03 13:50:12 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:50:12 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:50:12 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1963385228</nova:name>
Nov 03 13:50:12 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:50:12</nova:creationTime>
Nov 03 13:50:12 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:50:12 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:50:12 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:50:12 user nova-compute[74582]:       <nova:owner>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:user uuid="f64445061a214d13992b8b3bbacfb0c0">tempest-AttachVolumeNegativeTest-1460772866-project-member</nova:user>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:project uuid="d438a60c19854c4a93593908fb9b4390">tempest-AttachVolumeNegativeTest-1460772866</nova:project>
Nov 03 13:50:12 user nova-compute[74582]:       </nova:owner>
Nov 03 13:50:12 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:50:12 user nova-compute[74582]:       <nova:ports>
Nov 03 13:50:12 user nova-compute[74582]:         <nova:port uuid="69a43c35-3a4e-4316-91dd-061c62542fb8">
Nov 03 13:50:12 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 13:50:12 user nova-compute[74582]:         </nova:port>
Nov 03 13:50:12 user nova-compute[74582]:       </nova:ports>
Nov 03 13:50:12 user nova-compute[74582]:     </nova:instance>
Nov 03 13:50:12 user nova-compute[74582]:   </metadata>
Nov 03 13:50:12 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:50:12 user nova-compute[74582]:     <system>
Nov 03 13:50:12 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:50:12 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:50:12 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:50:12 user nova-compute[74582]:       <entry name="serial">b9636f0f-472d-40f5-bb99-3c11296ba1c5</entry>
Nov 03 13:50:12 user nova-compute[74582]:       <entry name="uuid">b9636f0f-472d-40f5-bb99-3c11296ba1c5</entry>
Nov 03 13:50:12 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:50:12 user nova-compute[74582]:     </system>
Nov 03 13:50:12 user nova-compute[74582]:   </sysinfo>
Nov 03 13:50:12 user nova-compute[74582]:   <os>
Nov 03 13:50:12 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:50:12 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:50:12 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:50:12 user nova-compute[74582]:   </os>
Nov 03 13:50:12 user nova-compute[74582]:   <features>
Nov 03 13:50:12 user nova-compute[74582]:     <acpi/>
Nov 03 13:50:12 user nova-compute[74582]:     <apic/>
Nov 03 13:50:12 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:50:12 user nova-compute[74582]:   </features>
Nov 03 13:50:12 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:50:12 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:50:12 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:50:12 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:50:12 user nova-compute[74582]:   </clock>
Nov 03 13:50:12 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:50:12 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:50:12 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:50:12 user nova-compute[74582]:   </cpu>
Nov 03 13:50:12 user nova-compute[74582]:   <devices>
Nov 03 13:50:12 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:50:12 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:50:12 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk"/>
Nov 03 13:50:12 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:50:12 user nova-compute[74582]:     </disk>
Nov 03 13:50:12 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:50:12 user nova-compute[74582]:       <mac address="fa:16:3e:e3:6d:19"/>
Nov 03 13:50:12 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:50:12 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:50:12 user nova-compute[74582]:       <target dev="tap69a43c35-3a"/>
Nov 03 13:50:12 user nova-compute[74582]:     </interface>
Nov 03 13:50:12 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:50:12 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/console.log" append="off"/>
Nov 03 13:50:12 user nova-compute[74582]:     </serial>
Nov 03 13:50:12 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:50:12 user nova-compute[74582]:     <video>
Nov 03 13:50:12 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:50:12 user nova-compute[74582]:     </video>
Nov 03 13:50:12 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:50:12 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:50:12 user nova-compute[74582]:     </rng>
Nov 03 13:50:12 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:50:12 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:50:12 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:50:12 user nova-compute[74582]:     </memballoon>
Nov 03 13:50:12 user nova-compute[74582]:   </devices>
Nov 03 13:50:12 user nova-compute[74582]: </domain>
Nov 03 13:50:12 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1963385228',display_name='tempest-AttachVolumeNegativeTest-server-1963385228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1963385228',id=12,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa3xP7/sxvwxS9UvK3LGvqgSVMT6MBKIi5YereHLVNp2dXY1b8Sgr9KnUMD59onTk4kA5haNgVLKbk+n+X19m5thLjSaNYsnU7PL15yWWipfHuzlmp33g3I5RMCC/6m4g==',key_name='tempest-keypair-666006040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-1bc580p8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=b9636f0f-472d-40f5-bb99-3c11296ba1c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG os_vif [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04c437f7-09a9-591d-ae0b-a0bc972dbd15', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:12 user nova-compute[74582]: INFO nova.compute.manager [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Attaching volume 6d4ea099-378f-4780-ba17-e4b94b8db8bc to /dev/vdb
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69a43c35-3a, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69a43c35-3a, col_values=(('qos', UUID('dc34d0bb-e9ec-4042-aa49-f7b1afcf6733')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69a43c35-3a, col_values=(('external_ids', {'iface-id': '69a43c35-3a4e-4316-91dd-061c62542fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:6d:19', 'vm-uuid': 'b9636f0f-472d-40f5-bb99-3c11296ba1c5'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:12 user nova-compute[74582]: INFO os_vif [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a')
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:e3:6d:19, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG os_brick.utils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9ee86-1eca-482a-b63d-b1b37f2c1519]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[62067f36-7199-419a-9c22-065c83054b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[253233fd-a233-43cb-9c3a-ca1b66f5fa4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ca16a-49e7-4647-998c-a976aec4f46d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:50:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG nova.network.neutron [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Updated VIF entry in instance network info cache for port 69a43c35-3a4e-4316-91dd-061c62542fb8. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG nova.network.neutron [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Updating instance_info_cache with network_info: [{"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:50:13 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:50:13 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c638f9d6-5494-45b4-8124-09b1e8fd1ac4]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG os_brick.utils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updating existing volume attachment record: 5b2fe5a2-51d1-431f-9ace-848c84bfd25d {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:50:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bcd640cf-4616-49ab-a066-2fd42efc2efd req-dea7f22e-48d4-4899-9109-ce4ea3314f51 service nova] Releasing lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-2e27ba3a-d446-40c3-933a-3205016059d3 req-8455adb5-f735-48c2-986c-f697db9948f6 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e27ba3a-d446-40c3-933a-3205016059d3 req-8455adb5-f735-48c2-986c-f697db9948f6 service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e27ba3a-d446-40c3-933a-3205016059d3 req-8455adb5-f735-48c2-986c-f697db9948f6 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e27ba3a-d446-40c3-933a-3205016059d3 req-8455adb5-f735-48c2-986c-f697db9948f6 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-2e27ba3a-d446-40c3-933a-3205016059d3 req-8455adb5-f735-48c2-986c-f697db9948f6 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:14 user nova-compute[74582]: WARNING nova.compute.manager [req-2e27ba3a-d446-40c3-933a-3205016059d3 req-8455adb5-f735-48c2-986c-f697db9948f6 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state building and task_state spawning.
Nov 03 13:50:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:50:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Instance spawned successfully.
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-3556bc4f-e3c6-414b-b64c-a55734950c2f req-ccec25da-630e-40c7-a438-8cc229e40d17 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3556bc4f-e3c6-414b-b64c-a55734950c2f req-ccec25da-630e-40c7-a438-8cc229e40d17 service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3556bc4f-e3c6-414b-b64c-a55734950c2f req-ccec25da-630e-40c7-a438-8cc229e40d17 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3556bc4f-e3c6-414b-b64c-a55734950c2f req-ccec25da-630e-40c7-a438-8cc229e40d17 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-3556bc4f-e3c6-414b-b64c-a55734950c2f req-ccec25da-630e-40c7-a438-8cc229e40d17 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:16 user nova-compute[74582]: WARNING nova.compute.manager [req-3556bc4f-e3c6-414b-b64c-a55734950c2f req-ccec25da-630e-40c7-a438-8cc229e40d17 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state building and task_state spawning.
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:50:16 user nova-compute[74582]: INFO nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 03 13:50:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:50:16 user nova-compute[74582]: INFO nova.compute.manager [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Took 7.20 seconds to build instance.
Nov 03 13:50:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7faf5d67-e917-4de8-ab48-b64dd69c815e tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.483s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:50:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsboedtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:18 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:18 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:18 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:50:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05f3ed-fbfc-4f18-9aac-a2605100d663]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:50:19 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[08febdbc-38df-48de-9d62-9c1c5512aff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d] added
Nov 03 13:50:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc5d8a-3b58-4338-b8c7-df55e9cb0026]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a901a0-69e6-4185-be60-a308459c58df]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsboedtv {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsboedtv" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d07bfa6-ad14-42fa-b8dd-8fac5e76c977]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qsboedtv'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeHBNmDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:19 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39dac32-7d0d-4f6e-a225-88ebb2507090]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd743c-4fba-484a-969a-7e0fe5913dbe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1482b9-026b-4b7c-9148-fff734ee529b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260]
Nov 03 13:50:19 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc463eb-7a53-4c98-a929-5b803b9f791a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad48a9c-cda2-4059-b404-1e6aff44523d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:19 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[743d9357-1502-4b43-987e-6907dd99be16]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsboedtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23963646439356631', 'path': '/dev/sdf'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963646439356631', 'path': '/dev/sdf'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.219s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:20 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:20 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'flavor' on Instance uuid 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c97c37-9963-4faf-825d-e76c9c376810]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:50:20 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:50:20 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:20 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:50:20 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:20 user nova-compute[74582]:   <serial>6c00e173-2810-4912-9b60-4d9202a3712d</serial>
Nov 03 13:50:20 user nova-compute[74582]: </disk>
Nov 03 13:50:20 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[20565272-4e2e-4d42-b74e-9f18316c9caa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4] added
Nov 03 13:50:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794c46b-0cda-4999-9e46-cfb559d94c6a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a438b-c0ac-492b-830f-1804869fec43]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeHBNmDY {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeHBNmDY" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06013e79-ed81-46bd-a35d-668e9160e11e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeHBNmDY'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a3da3-f254-4a02-a0bb-5a7983c0b682]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f57e5-5f5f-4cf0-96c9-3fab0c0a3a35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3be5613-cf3d-4719-9f01-6ac7c4eb80cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260]
Nov 03 13:50:20 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb27260-5b24-4a89-b6df-2536e592ab3f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a75634-0a7d-458a-a08d-dc9c8c05b964]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:20 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf5f80d-c7e3-4195-a160-f55af6928d8d]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeHBNmDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No VIF found with MAC fa:16:3e:8f:a7:bf, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:50:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03c0f6ed-c631-4ad1-b7c6-01f4c98cb557 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.094s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] <== connect_volume: return (2587ms) {'type': 'block', 'scsi_wwn': '23432646139313539', 'path': '/dev/sdg'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432646139313539', 'path': '/dev/sdg'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:50:21 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lazy-loading 'flavor' on Instance uuid a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] attach device xml: <disk type="block" device="disk">
Nov 03 13:50:21 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:21 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 13:50:21 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:21 user nova-compute[74582]:   <serial>a88c0b68-0565-449f-bd09-8d7c23821ed4</serial>
Nov 03 13:50:21 user nova-compute[74582]: </disk>
Nov 03 13:50:21 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:22 user nova-compute[74582]: INFO nova.compute.manager [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Detaching volume 6c00e173-2810-4912-9b60-4d9202a3712d
Nov 03 13:50:22 user nova-compute[74582]: INFO nova.virt.block_device [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Attempting to driver detach volume 6c00e173-2810-4912-9b60-4d9202a3712d from mountpoint /dev/vdb
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Attempting to detach device vdb from instance 1294e014-eed1-4016-a1a4-c3977799f4d4 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:50:22 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:22 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:50:22 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:22 user nova-compute[74582]:   <serial>6c00e173-2810-4912-9b60-4d9202a3712d</serial>
Nov 03 13:50:22 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:50:22 user nova-compute[74582]: </disk>
Nov 03 13:50:22 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:50:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Successfully detached device vdb from instance 1294e014-eed1-4016-a1a4-c3977799f4d4 from the persistent domain config.
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1294e014-eed1-4016-a1a4-c3977799f4d4 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:50:22 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:22 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:50:22 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:22 user nova-compute[74582]:   <serial>6c00e173-2810-4912-9b60-4d9202a3712d</serial>
Nov 03 13:50:22 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:50:22 user nova-compute[74582]: </disk>
Nov 03 13:50:22 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] No VIF found with MAC fa:16:3e:c5:87:28, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e680575b-30dc-4040-9857-1ac0df3b8ff3 tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.771s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:50:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] volume_snapshot_create: create_info: {'snapshot_id': 'af5a9acc-1ede-44a4-b84b-86909c409f4e', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74582) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 03 13:50:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] snap xml: <domainsnapshot>
Nov 03 13:50:23 user nova-compute[74582]:   <disks>
Nov 03 13:50:23 user nova-compute[74582]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 03 13:50:23 user nova-compute[74582]:       <source file="/dev/new_file"/>
Nov 03 13:50:23 user nova-compute[74582]:     </disk>
Nov 03 13:50:23 user nova-compute[74582]:     <disk name="vda" snapshot="no"/>
Nov 03 13:50:23 user nova-compute[74582]:   </disks>
Nov 03 13:50:23 user nova-compute[74582]: </domainsnapshot>
Nov 03 13:50:23 user nova-compute[74582]:  {{(pid=74582) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 03 13:50:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] Lazy-loading 'system_metadata' on Instance uuid a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3257ed99-d2ee-44fc-ac0d-a213bfbcbd2a tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] volume_snapshot_delete: delete_info: {'volume_id': 'a88c0b68-0565-449f-bd09-8d7c23821ed4'} {{(pid=74582) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [None req-3257ed99-d2ee-44fc-ac0d-a213bfbcbd2a tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Traceback (most recent call last):
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     if delete_info['type'] != 'qcow2':
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] KeyError: 'type'
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] 
Nov 03 13:50:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Traceback (most recent call last):
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     rv = execute(f, *args, **kwargs)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     six.reraise(c, e, tb)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     raise value
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     rv = meth(*args, **kwargs)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] 
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Traceback (most recent call last):
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     self._volume_snapshot_create(context, instance, guest,
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     rv = execute(f, *args, **kwargs)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     six.reraise(c, e, tb)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     raise value
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     rv = meth(*args, **kwargs)
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:23 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [None req-3257ed99-d2ee-44fc-ac0d-a213bfbcbd2a tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6e3af445-59df-49a7-9e34-4158fb23ec32)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server [None req-3257ed99-d2ee-44fc-ac0d-a213bfbcbd2a tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] Exception during message handling: KeyError: 'type'
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot af5a9acc-1ede-44a4-b84b-86909c409f4e could not be found.
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise value
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot af5a9acc-1ede-44a4-b84b-86909c409f4e could not be found. (HTTP 404) (Request-ID: req-ea23d6d7-3489-44e0-9f87-bb69e68b3eb2)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot af5a9acc-1ede-44a4-b84b-86909c409f4e could not be found.
Nov 03 13:50:24 user nova-compute[74582]: ERROR nova.virt.libvirt.driver 
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server [None req-34080001-e788-46dd-a40a-c41afd594225 tempest-VolumesAssistedSnapshotsTest-549822688 tempest-VolumesAssistedSnapshotsTest-549822688-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise value
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 13:50:24 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:50:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:24 user nova-compute[74582]: INFO nova.compute.manager [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Detaching volume a88c0b68-0565-449f-bd09-8d7c23821ed4
Nov 03 13:50:24 user nova-compute[74582]: INFO nova.virt.block_device [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Attempting to driver detach volume a88c0b68-0565-449f-bd09-8d7c23821ed4 from mountpoint /dev/vdb
Nov 03 13:50:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Attempting to detach device vdb from instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:50:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 13:50:24 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:24 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 13:50:24 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:24 user nova-compute[74582]:   <serial>a88c0b68-0565-449f-bd09-8d7c23821ed4</serial>
Nov 03 13:50:24 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:50:24 user nova-compute[74582]: </disk>
Nov 03 13:50:24 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:50:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Successfully detached device vdb from instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 from the persistent domain config.
Nov 03 13:50:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:50:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 13:50:24 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:24 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 13:50:24 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:24 user nova-compute[74582]:   <serial>a88c0b68-0565-449f-bd09-8d7c23821ed4</serial>
Nov 03 13:50:24 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:50:24 user nova-compute[74582]: </disk>
Nov 03 13:50:24 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:50:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:50:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-changed-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Refreshing instance network info cache due to event network-changed-ecbe0296-b0a8-497a-b256-3540a095f4a0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] Acquiring lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] Acquired lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Refreshing network info cache for port ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:50:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 is timed out.
Nov 03 13:50:28 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Successfully detached device sdc from instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 from the live domain config.
Nov 03 13:50:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHtZazeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:28 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4ba21-9a1e-4e78-83a7-c47853b28170]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:50:28 user nova-compute[74582]: No targets found.
Nov 03 13:50:28 user nova-compute[74582]: iSNS:
Nov 03 13:50:28 user nova-compute[74582]: No targets found.
Nov 03 13:50:28 user nova-compute[74582]: STATIC:
Nov 03 13:50:28 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:50:28 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:28 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:28 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d
Nov 03 13:50:28 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:28 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:28 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6
Nov 03 13:50:28 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:28 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:28 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36
Nov 03 13:50:28 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:28 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:28 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4
Nov 03 13:50:28 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:28 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:28 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:50:28 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:28 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:28 user nova-compute[74582]: FIRMWARE:
Nov 03 13:50:28 user nova-compute[74582]: No targets found.
Nov 03 13:50:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:50:28 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:50:28 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b28144-44b4-4b9b-b642-ed7a8c27de6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1899713b-b6f2-4919-8a4f-f556f639bb58]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:28 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68404700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6'): ({'sde'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Removing single pathed devices sde {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e06f4c-ac76-46ed-91f3-f4970a544b8c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee08a9e2-87ae-4c41-8531-3486eb3d4cc9]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Flushing IO for device /dev/sde {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c9bf1-b56a-4646-977e-dd5790ab91d0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.065s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb54213f-9963-4a17-8914-fd40863bbdce]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b11003-c457-40ec-b83c-debc87476e90]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7abd7a-7c64-495a-91a6-30326ab342d7]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260]
Nov 03 13:50:29 user nova-compute[74582]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:29 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2333dcc2-a8f2-4a02-816a-d9b8d88bd7f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d2b01b-cf78-48b8-8c2e-3cc5625fa040]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] <== disconnect_volume: return (470ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG nova.network.neutron [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updated VIF entry in instance network info cache for port ecbe0296-b0a8-497a-b256-3540a095f4a0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG nova.network.neutron [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updating instance_info_cache with network_info: [{"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-defadff1-f476-4273-ad34-a371e812caeb req-4b7b9b7f-b607-45eb-a622-fd8f27dda721 service nova] Releasing lock "refresh_cache-01985e3c-5b20-4701-99c7-d374f5a2d76d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:50:30 user nova-compute[74582]: INFO nova.compute.manager [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Rebuilding instance
Nov 03 13:50:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-1d76d230-12eb-4b56-8dee-1dbdb2eb3a2e req-4a884e2e-0597-43d5-b8ff-3105f9e0cb61 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-vif-unplugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1d76d230-12eb-4b56-8dee-1dbdb2eb3a2e req-4a884e2e-0597-43d5-b8ff-3105f9e0cb61 service nova] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1d76d230-12eb-4b56-8dee-1dbdb2eb3a2e req-4a884e2e-0597-43d5-b8ff-3105f9e0cb61 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1d76d230-12eb-4b56-8dee-1dbdb2eb3a2e req-4a884e2e-0597-43d5-b8ff-3105f9e0cb61 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-1d76d230-12eb-4b56-8dee-1dbdb2eb3a2e req-4a884e2e-0597-43d5-b8ff-3105f9e0cb61 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] No waiting events found dispatching network-vif-unplugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:30 user nova-compute[74582]: WARNING nova.compute.manager [req-1d76d230-12eb-4b56-8dee-1dbdb2eb3a2e req-4a884e2e-0597-43d5-b8ff-3105f9e0cb61 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received unexpected event network-vif-unplugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 for instance with vm_state active and task_state rebuilding.
Nov 03 13:50:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance destroyed successfully.
Nov 03 13:50:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance destroyed successfully.
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-372437466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-241734421',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0Z3EAdEMgKPBJmHJky1vcmcINe+C3ixOHfIGjUzaCZAJW6x21cpktz5sjhOxSWyL0+kP774Jlq+c74EGE/G/pLJyvCvugq+X8qBcYiboqtZNXzbto+ZRWAVuUbWiBBtg==',key_name='tempest-keypair-1401802885',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6108f707190e46d7808a7c5ac5b1c2bf',ramdisk_id='',reservation_id='r-6ncqv720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1647953654',owner_user_name='tempest-ServerActionsV293TestJSON-1647953654-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='337fa0f2b5964789a76d2663c9f73f1c',uuid=01985e3c-5b20-4701-99c7-d374f5a2d76d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converting VIF {"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_vif [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecbe0296-b0, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=208e1483-26f2-43cd-8844-ac710f1ed4d5) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:31 user nova-compute[74582]: INFO os_vif [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0')
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDwhiMCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:31 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c98e421-e101-4be9-8608-9b635af173e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:50:31 user nova-compute[74582]: No targets found.
Nov 03 13:50:31 user nova-compute[74582]: iSNS:
Nov 03 13:50:31 user nova-compute[74582]: No targets found.
Nov 03 13:50:31 user nova-compute[74582]: STATIC:
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: FIRMWARE:
Nov 03 13:50:31 user nova-compute[74582]: No targets found.
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:50:31 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:50:31 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b454d-3c89-49ba-aa49-3996f327e438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ccfbd-65dc-400f-ab6b-236593316ad5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f801fde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6182662-6d67-48d9-a659-e34902911756]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3ac0f-aa43-48f6-911d-fab200e5aa7d]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25477d2-c4ba-4b50-9693-cf67d6337b19]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527e3c3-1da0-471c-90d5-72c3cdfb8ef5]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOea9721e4-d523ee6ee17c42a7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ea9721e4', '/dev/disk/by-id/scsi-26435323365653665') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbdc415-9c40-416b-bdd0-d47777f5c0c5]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb80351-dbae-42d5-8c1e-67343e2465a1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c40a3c4-2c21-4697-bf78-25baef434c54]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260]
Nov 03 13:50:31 user nova-compute[74582]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c484781d-4c6c-4fc7-a96a-d5a45cc6504d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] <== disconnect_volume: return (334ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:50:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Deleting instance files /opt/stack/data/nova/instances/01985e3c-5b20-4701-99c7-d374f5a2d76d_del
Nov 03 13:50:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Deletion of /opt/stack/data/nova/instances/01985e3c-5b20-4701-99c7-d374f5a2d76d_del complete
Nov 03 13:50:31 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d could not be found.
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDwhiMCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:31 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3982d75c-bee6-4039-9e16-4e01d0863228]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:50:31 user nova-compute[74582]: No targets found.
Nov 03 13:50:31 user nova-compute[74582]: iSNS:
Nov 03 13:50:31 user nova-compute[74582]: No targets found.
Nov 03 13:50:31 user nova-compute[74582]: STATIC:
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:50:31 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:31 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:31 user nova-compute[74582]: FIRMWARE:
Nov 03 13:50:31 user nova-compute[74582]: No targets found.
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:50:31 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:50:31 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c65dda3-3a85-408c-b682-e0459eab4288]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fb37f3-4ab3-4a7a-b406-95003afcf15f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:31 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f801fe050>, {}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Disconnecting from: [] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] <== disconnect_volume: return (71ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG nova.compute.manager [req-259a224b-8b63-42f2-9dee-2cdffd80ee8d req-ab94aa15-d4c8-46d1-92d0-741cf723a2b1 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-259a224b-8b63-42f2-9dee-2cdffd80ee8d req-ab94aa15-d4c8-46d1-92d0-741cf723a2b1 service nova] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-259a224b-8b63-42f2-9dee-2cdffd80ee8d req-ab94aa15-d4c8-46d1-92d0-741cf723a2b1 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-259a224b-8b63-42f2-9dee-2cdffd80ee8d req-ab94aa15-d4c8-46d1-92d0-741cf723a2b1 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG nova.compute.manager [req-259a224b-8b63-42f2-9dee-2cdffd80ee8d req-ab94aa15-d4c8-46d1-92d0-741cf723a2b1 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] No waiting events found dispatching network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:32 user nova-compute[74582]: WARNING nova.compute.manager [req-259a224b-8b63-42f2-9dee-2cdffd80ee8d req-ab94aa15-d4c8-46d1-92d0-741cf723a2b1 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received unexpected event network-vif-plugged-ecbe0296-b0a8-497a-b256-3540a095f4a0 for instance with vm_state active and task_state rebuilding.
Nov 03 13:50:32 user nova-compute[74582]: DEBUG nova.compute.manager [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Preparing to wait for external event volume-reimaged-97f5eb24-2bbe-41ee-afaf-2181e957bd36 {{(pid=74582) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lazy-loading 'flavor' on Instance uuid a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1c9f034-5ae8-4a70-8f7d-74661f312825 tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.664s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:37 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:37 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:37 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[882da367-f534-40d0-b021-e0f66667020f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:50:37 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05a3500-8bf7-4f7d-85b9-d34024b37531]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc] added
Nov 03 13:50:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9358b3f-0da7-4f93-b121-ebb7b3b23c41]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5b207-b486-4e2b-9e08-511f3fc82aa3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v djbgVeMS {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v djbgVeMS" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a43873-7c03-4484-8d69-bc8e1f515fa4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'djbgVeMS'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9498f89-0bed-4268-bbd1-8c9625694e35]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290c5c1-853a-4588-9dec-5776f18fe80b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:37 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:37 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:37 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:37 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:37 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:37 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83d62e-435e-4fbd-9bec-bb5d8f9f14c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]
Nov 03 13:50:38 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:38 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8de2d-8729-4b8c-88d4-15cb9af70b3a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdf218b-f462-4ed5-897e-c5895d99327a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:50:38 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:38 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:50:38 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6b16a0-91ca-47a2-9946-6f7c3ff5bdea]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:50:38 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:39 user nova-compute[74582]: INFO nova.compute.manager [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Terminating instance
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23264393462363962', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264393462363962', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.objects.instance [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lazy-loading 'flavor' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:50:39 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:50:39 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 13:50:39 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:50:39 user nova-compute[74582]:   <serial>6d4ea099-378f-4780-ba17-e4b94b8db8bc</serial>
Nov 03 13:50:39 user nova-compute[74582]: </disk>
Nov 03 13:50:39 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-71a7de78-0db2-4d3c-ac97-29925be3f08a req-79ceb13b-76e5-4c23-b340-767c9b688ddb service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-vif-unplugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-71a7de78-0db2-4d3c-ac97-29925be3f08a req-79ceb13b-76e5-4c23-b340-767c9b688ddb service nova] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-71a7de78-0db2-4d3c-ac97-29925be3f08a req-79ceb13b-76e5-4c23-b340-767c9b688ddb service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-71a7de78-0db2-4d3c-ac97-29925be3f08a req-79ceb13b-76e5-4c23-b340-767c9b688ddb service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-71a7de78-0db2-4d3c-ac97-29925be3f08a req-79ceb13b-76e5-4c23-b340-767c9b688ddb service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] No waiting events found dispatching network-vif-unplugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-71a7de78-0db2-4d3c-ac97-29925be3f08a req-79ceb13b-76e5-4c23-b340-767c9b688ddb service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-vif-unplugged-b54551bb-7df9-45cf-b125-75f48e263d65 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] No VIF found with MAC fa:16:3e:bd:42:13, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41d13b2d-e498-4000-b046-7f47ed38f7a9 tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.156s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:39 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Instance destroyed successfully.
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lazy-loading 'resources' on Instance uuid a70cc9a8-f2fd-45ed-8b66-15e0356d90c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-49236409',display_name='tempest-AttachSCSIVolumeTestJSON-server-49236409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-49236409',id=7,image_ref='a409b55d-0c56-4bf4-925e-c8974e5d4349',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ/VKWob2TY8crp/ZVFEROoDL86fqycXLEoect5okqSK3iFyPSgtN3omFz7Co75ktisOHwH+i0gmzpAxAB/zOAa9K40k6rsIs0/yqBOshyiwJSXMlqvQUKSR+1TwO8Vg==',key_name='tempest-keypair-1498287829',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ab503f4be744a5db2609583507cfc97',ramdisk_id='',reservation_id='r-znx0srxs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a409b55d-0c56-4bf4-925e-c8974e5d4349',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-367800724',owner_user_name='tempest-AttachSCSIVolumeTestJSON-367800724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:47:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c11c727035264271af47d2822e392543',uuid=a70cc9a8-f2fd-45ed-8b66-15e0356d90c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Converting VIF {"id": "b54551bb-7df9-45cf-b125-75f48e263d65", "address": "fa:16:3e:c2:83:56", "network": {"id": "bba05606-8f2d-4e9c-b2f7-7f121a588f63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2064983347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ab503f4be744a5db2609583507cfc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb54551bb-7d", "ovs_interfaceid": "b54551bb-7df9-45cf-b125-75f48e263d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG os_vif [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb54551bb-7d, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a91ae555-0243-4f60-b0e3-40bde0bb99cc) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:40 user nova-compute[74582]: INFO os_vif [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:83:56,bridge_name='br-int',has_traffic_filtering=True,id=b54551bb-7df9-45cf-b125-75f48e263d65,network=Network(bba05606-8f2d-4e9c-b2f7-7f121a588f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb54551bb-7d')
Nov 03 13:50:40 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Deleting instance files /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2_del
Nov 03 13:50:40 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Deletion of /opt/stack/data/nova/instances/a70cc9a8-f2fd-45ed-8b66-15e0356d90c2_del complete
Nov 03 13:50:40 user nova-compute[74582]: INFO nova.compute.manager [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 03 13:50:40 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:50:40 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:50:40 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:50:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:41 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Took 0.99 seconds to deallocate network for instance.
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] Acquiring lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] No waiting events found dispatching network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:41 user nova-compute[74582]: WARNING nova.compute.manager [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received unexpected event network-vif-plugged-b54551bb-7df9-45cf-b125-75f48e263d65 for instance with vm_state deleted and task_state None.
Nov 03 13:50:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-0ef6360c-cdb2-4af1-97dd-13673e5bfacc req-44bc566f-92cd-4681-b7b9-7716044b9b14 service nova] [instance: a70cc9a8-f2fd-45ed-8b66-15e0356d90c2] Received event network-vif-deleted-b54551bb-7df9-45cf-b125-75f48e263d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG os_brick.utils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e266661-5eb6-4f4f-a9fe-1323e2083812]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:41 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Deleted allocations for instance a70cc9a8-f2fd-45ed-8b66-15e0356d90c2
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925e5aa-653c-40c7-9ad3-e146da037859]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7069fc63-c2e7-4a7c-bcd1-825c3ea0c517]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7b4678-5f46-445c-af11-3609da9958a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:50:41 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f758a-95e9-4b5e-acf2-fd6149316de3]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG os_brick.utils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7b2ccc4b-b683-4869-aec4-18a3f44c416f tempest-AttachSCSIVolumeTestJSON-367800724 tempest-AttachSCSIVolumeTestJSON-367800724-project-member] Lock "a70cc9a8-f2fd-45ed-8b66-15e0356d90c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:41 user nova-compute[74582]: INFO nova.compute.manager [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Swapping volume 6d4ea099-378f-4780-ba17-e4b94b8db8bc for 46d7568c-7296-4fc2-bfc6-3492e919608a
Nov 03 13:50:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:42 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1294e014-eed1-4016-a1a4-c3977799f4d4 is timed out.
Nov 03 13:50:42 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Successfully detached device vdb from instance 1294e014-eed1-4016-a1a4-c3977799f4d4 from the live domain config.
Nov 03 13:50:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsboedtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:42 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f843434a-370a-44df-9d5b-2e6489cd9b4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:50:42 user nova-compute[74582]: No targets found.
Nov 03 13:50:42 user nova-compute[74582]: iSNS:
Nov 03 13:50:42 user nova-compute[74582]: No targets found.
Nov 03 13:50:42 user nova-compute[74582]: STATIC:
Nov 03 13:50:42 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:50:42 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:42 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:42 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d
Nov 03 13:50:42 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:42 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:42 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3
Nov 03 13:50:42 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:42 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:42 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:50:42 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:42 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:42 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4
Nov 03 13:50:42 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:42 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:42 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:50:42 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:42 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:42 user nova-compute[74582]: FIRMWARE:
Nov 03 13:50:42 user nova-compute[74582]: No targets found.
Nov 03 13:50:42 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:50:42 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:50:42 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0ead4-8f12-46bd-a15a-92eaf4a38d75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccef230-489a-4e76-a19a-5c9e4b28a575]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:50:42 user nova-compute[74582]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3 (non-flash)
Nov 03 13:50:42 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68722e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d'): ({'sdf'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Removing single pathed devices sdf {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d651a-937a-4f35-8480-1e901be30838]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d0597-a0e1-4562-a19f-9256451d684a]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Flushing IO for device /dev/sdf {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf65196-5993-439c-8954-e258ffd90abf]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b3f9b5-0daa-41d0-bafe-d9b69bb904e1]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e59e0a-6cc2-4f52-99ab-be4e22231bfe]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d391c-77b5-489a-8132-2426a317a052]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260]
Nov 03 13:50:43 user nova-compute[74582]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c00e173-2810-4912-9b60-4d9202a3712d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f05da-ae07-4528-a1c0-5353b79dfbc1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] <== disconnect_volume: return (304ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'flavor' on Instance uuid 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d7959556-c967-4c8f-839f-9fdf777a3fe9 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.950s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 is timed out.
Nov 03 13:50:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Successfully detached device vdb from instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 from the live domain config.
Nov 03 13:50:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeHBNmDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:50:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:50:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3749c583-5853-4e8f-b983-25a4a695c857]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:50:44 user nova-compute[74582]: No targets found.
Nov 03 13:50:44 user nova-compute[74582]: iSNS:
Nov 03 13:50:44 user nova-compute[74582]: No targets found.
Nov 03 13:50:44 user nova-compute[74582]: STATIC:
Nov 03 13:50:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:50:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3
Nov 03 13:50:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:50:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4
Nov 03 13:50:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:50:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:50:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:50:44 user nova-compute[74582]: FIRMWARE:
Nov 03 13:50:44 user nova-compute[74582]: No targets found.
Nov 03 13:50:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:50:44 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:50:44 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54b0156-bcfb-488e-9882-a3de19fd0918]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db93b1d-6bb7-4fea-9265-081df54d0000]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:50:45 user nova-compute[74582]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a871e1-2abf-436c-9242-a63a750586b3 (non-flash)
Nov 03 13:50:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683c1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4'): ({'sdg'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Removing single pathed devices sdg {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9109b3b9-7a55-4b9c-9004-6cbea5b7f830]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f001152-af5d-4901-ae17-e417e2a7eab2]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Flushing IO for device /dev/sdg {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeb6012-5951-4666-a083-a93100ac2a98]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49cdf6c-92a8-480d-9717-3c464aa75a2f]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c3ced-d700-439c-b0d5-de6e09fa7aed]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5df5403-f9d1-4a84-9427-b5d5c8c0fa3e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260]
Nov 03 13:50:45 user nova-compute[74582]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4, portal: 172.16.0.220,3260] successful.
Nov 03 13:50:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a88c0b68-0565-449f-bd09-8d7c23821ed4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c271d8b7-1cb4-4b7e-8d6c-fe2bd4a2f449]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] <== disconnect_volume: return (325ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lazy-loading 'flavor' on Instance uuid a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c28aa375-5049-406b-9577-008f5f01bb1c tempest-VolumesAssistedSnapshotsTest-42596154 tempest-VolumesAssistedSnapshotsTest-42596154-project-admin] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:50:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:50:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:50:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=25.488937377929688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 926114b3-1849-465b-94fb-3a1d6e49d56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ddfed1ce-d154-45c4-932d-84804e020499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b9636f0f-472d-40f5-bb99-3c11296ba1c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:50:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:50:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating instance_info_cache with network_info: [{"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-02c8e503-1dce-4a76-adc7-93b3f04985ce" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:50:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:50:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "ddfed1ce-d154-45c4-932d-84804e020499" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:56 user nova-compute[74582]: INFO nova.compute.manager [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Terminating instance
Nov 03 13:50:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-84e54877-82a4-4947-80df-edeef9eb6cc5 req-d66acfea-4591-4cc8-82df-d9cdc7c1c540 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-unplugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84e54877-82a4-4947-80df-edeef9eb6cc5 req-d66acfea-4591-4cc8-82df-d9cdc7c1c540 service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84e54877-82a4-4947-80df-edeef9eb6cc5 req-d66acfea-4591-4cc8-82df-d9cdc7c1c540 service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84e54877-82a4-4947-80df-edeef9eb6cc5 req-d66acfea-4591-4cc8-82df-d9cdc7c1c540 service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-84e54877-82a4-4947-80df-edeef9eb6cc5 req-d66acfea-4591-4cc8-82df-d9cdc7c1c540 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-unplugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-84e54877-82a4-4947-80df-edeef9eb6cc5 req-d66acfea-4591-4cc8-82df-d9cdc7c1c540 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-unplugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Instance destroyed successfully.
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lazy-loading 'resources' on Instance uuid ddfed1ce-d154-45c4-932d-84804e020499 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1132601184',display_name='tempest-ServersNegativeTestJSON-server-1132601184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1132601184',id=11,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:49:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1625c2271dab47af9751af0bb23fcd64',ramdisk_id='',reservation_id='r-20s58phw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-147568106',owner_user_name='tempest-ServersNegativeTestJSON-147568106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:49:15Z,user_data=None,user_id='2790fcec7e2e4ad0b653e5d45c98372e',uuid=ddfed1ce-d154-45c4-932d-84804e020499,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converting VIF {"id": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "address": "fa:16:3e:9d:ee:fc", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217c21f8-12", "ovs_interfaceid": "217c21f8-125f-4f42-bea7-a3a0b54a681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG os_vif [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217c21f8-12, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97e71658-0fe9-42c4-945f-5e86a1ff85f1) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: INFO os_vif [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ee:fc,bridge_name='br-int',has_traffic_filtering=True,id=217c21f8-125f-4f42-bea7-a3a0b54a681d,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217c21f8-12')
Nov 03 13:50:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Deleting instance files /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499_del
Nov 03 13:50:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Deletion of /opt/stack/data/nova/instances/ddfed1ce-d154-45c4-932d-84804e020499_del complete
Nov 03 13:50:57 user nova-compute[74582]: INFO nova.compute.manager [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 03 13:50:57 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: ddfed1ce-d154-45c4-932d-84804e020499] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:58 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Took 0.62 seconds to deallocate network for instance.
Nov 03 13:50:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-42005cc4-35b2-413a-9be5-a3c667f22a11 req-8533c86d-b004-4301-b66c-fcf75baa03a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-deleted-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:58 user nova-compute[74582]: INFO nova.compute.manager [req-42005cc4-35b2-413a-9be5-a3c667f22a11 req-8533c86d-b004-4301-b66c-fcf75baa03a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Neutron deleted interface 217c21f8-125f-4f42-bea7-a3a0b54a681d; detaching it from the instance and deleting it from the info cache
Nov 03 13:50:58 user nova-compute[74582]: DEBUG nova.network.neutron [req-42005cc4-35b2-413a-9be5-a3c667f22a11 req-8533c86d-b004-4301-b66c-fcf75baa03a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-42005cc4-35b2-413a-9be5-a3c667f22a11 req-8533c86d-b004-4301-b66c-fcf75baa03a8 service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Detach interface failed, port_id=217c21f8-125f-4f42-bea7-a3a0b54a681d, reason: Instance ddfed1ce-d154-45c4-932d-84804e020499 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:50:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:58 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Deleted allocations for instance ddfed1ce-d154-45c4-932d-84804e020499
Nov 03 13:50:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b13484d6-52c9-4d0f-9f70-512fc9dc538d tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "ddfed1ce-d154-45c4-932d-84804e020499" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:59 user nova-compute[74582]: WARNING nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state deleted and task_state None.
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:59 user nova-compute[74582]: WARNING nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state deleted and task_state None.
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:59 user nova-compute[74582]: WARNING nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state deleted and task_state None.
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-unplugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-unplugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:59 user nova-compute[74582]: WARNING nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-unplugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state deleted and task_state None.
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Acquiring lock "ddfed1ce-d154-45c4-932d-84804e020499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] Lock "ddfed1ce-d154-45c4-932d-84804e020499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:50:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] No waiting events found dispatching network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:50:59 user nova-compute[74582]: WARNING nova.compute.manager [req-58a0b480-6aef-4210-a2c9-fa9474927d41 req-a8011add-2a24-4cca-9ecb-daa23b8dcebc service nova] [instance: ddfed1ce-d154-45c4-932d-84804e020499] Received unexpected event network-vif-plugged-217c21f8-125f-4f42-bea7-a3a0b54a681d for instance with vm_state deleted and task_state None.
Nov 03 13:51:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vILERrCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '926114b3-1849-465b-94fb-3a1d6e49d56e', 'attached_at': '', 'detached_at': '', 'volume_id': '46d7568c-7296-4fc2-bfc6-3492e919608a', 'serial': '46d7568c-7296-4fc2-bfc6-3492e919608a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '926114b3-1849-465b-94fb-3a1d6e49d56e', 'attached_at': '', 'detached_at': '', 'volume_id': '6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'serial'} {{(pid=74582) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vILERrCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:03 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4429b2-f769-4263-adeb-ad0fef13f765]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:51:03 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ba247-f296-4bf5-b32d-94a0bf07ba36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a] added
Nov 03 13:51:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ddeacc-f104-472d-8a6f-7914816864d6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4990a0c2-cb00-4dfb-b87d-7aea220c647e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vILERrCQ {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vILERrCQ" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed11365d-fcc3-458c-aa01-e8a71e280909]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vILERrCQ'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f43020d-a1d4-45a6-ae63-0cafe967e102]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4cb1c-62e0-41a7-8d8e-492026bec570]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:51:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:51:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ed021-642d-4059-97c1-122508c854af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260]
Nov 03 13:51:03 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260] successful.
Nov 03 13:51:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf1933-1354-4fc8-8923-ac9f7deb8cc4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3c7d14-2da8-410f-80db-17b6b766c6b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:51:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:03 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:51:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513fe32-9e89-447c-955b-6501331768a1]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vILERrCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23164616263313866', 'path': '/dev/sde'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164616263313866', 'path': '/dev/sde'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lazy-loading 'flavor' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "da0950d0-3380-4104-8dca-023612958b01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:51:06 user nova-compute[74582]: INFO nova.compute.claims [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Claim successful on node user
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 419430400 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 558891008 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.network.neutron [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:51:06 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:51:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:51:07 user nova-compute[74582]: INFO nova.virt.block_device [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Booting with blank volume at /dev/vda
Nov 03 13:51:07 user nova-compute[74582]: DEBUG nova.policy [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e900eb8f4f6548f183010bc08a3c66f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc44a2fb46b4a649544d7e506a2d96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:51:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 722468864 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 859832320 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:08 user nova-compute[74582]: DEBUG nova.network.neutron [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Successfully created port: 1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:51:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 989855744 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:09 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[265169d4-e97b-454a-8f24-67207e59afde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:51:09 user nova-compute[74582]: No targets found.
Nov 03 13:51:09 user nova-compute[74582]: iSNS:
Nov 03 13:51:09 user nova-compute[74582]: No targets found.
Nov 03 13:51:09 user nova-compute[74582]: STATIC:
Nov 03 13:51:09 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:51:09 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:09 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:09 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a
Nov 03 13:51:09 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:09 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:09 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:51:09 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:09 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:09 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:51:09 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:09 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:09 user nova-compute[74582]: FIRMWARE:
Nov 03 13:51:09 user nova-compute[74582]: No targets found.
Nov 03 13:51:09 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:51:09 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:51:09 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11abe5-1f6a-4ad4-801a-7d4cf29654c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f28657-c078-4e8c-9e09-e33336bee776]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:09 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:09 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:09 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:51:09 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:09 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:09 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:09 user nova-compute[74582]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:51:09 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68723be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d5ebd-7058-43d4-8eac-483de106ccb6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e4f57-efff-45e3-9602-3ef75d21aaf2]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[270bce04-f620-4d9a-a583-67c101851f9f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5a7d8-67d8-44c5-a344-a01841911228]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb66f3-fa17-4106-b962-c86dcd95547c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c8462-546d-4922-86fc-709ac03aaad1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]
Nov 03 13:51:09 user nova-compute[74582]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.
Nov 03 13:51:09 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f44967-3a8d-43ea-9e4b-3c8e1300cbc7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] <== disconnect_volume: return (315ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Successfully updated port: 1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.compute.manager [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-changed-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.compute.manager [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Refreshing instance network info cache due to event network-changed-1609f201-4161-4c46-95a4-f307a062ee0f. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vILERrCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '926114b3-1849-465b-94fb-3a1d6e49d56e', 'attached_at': '', 'detached_at': '', 'volume_id': '46d7568c-7296-4fc2-bfc6-3492e919608a', 'serial'} {{(pid=74582) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] swap_volume: removing Cinder connection for volume 6d4ea099-378f-4780-ba17-e4b94b8db8bc {{(pid=74582) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance network_info: |[{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:09 user nova-compute[74582]: DEBUG nova.network.neutron [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Refreshing network info cache for port 1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:51:10 user nova-compute[74582]: DEBUG nova.network.neutron [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Updated VIF entry in instance network info cache for port 1609f201-4161-4c46-95a4-f307a062ee0f. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:51:10 user nova-compute[74582]: DEBUG nova.network.neutron [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fbe35ed5-cba2-4672-9767-ac89202cc12a req-afd68711-786c-4858-b0cc-0d2ad831fd58 service nova] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:12 user nova-compute[74582]: INFO nova.compute.manager [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Unshelving
Nov 03 13:51:12 user nova-compute[74582]: INFO nova.virt.block_device [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Booting with volume 12775148-ce24-4d39-82d8-798cef96bb32 at /dev/vdc
Nov 03 13:51:12 user nova-compute[74582]: DEBUG os_brick.utils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adfe050-9d6f-421e-8c35-ec485ad7db78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6beaf1-6429-4dba-9fe6-50b683248fb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04fc8c1-d55d-4ee0-9a33-e5127d03a64d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d90934-05ee-4ed2-97ea-81eb5d49c853]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:51:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:51:13 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:51:13 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[feecbec4-50ee-4f7f-ab1e-e24126542021]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG os_brick.utils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating existing volume attachment record: 7a654423-024c-466e-b6c0-f2e6360e8d24 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:13 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:51:13 user nova-compute[74582]: INFO nova.compute.claims [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Claim successful on node user
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:51:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.policy [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d8a8463e6b44b5a49ada2835baf0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789163764134874a379056ee7cf142b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:51:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Creating image(s)
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "/opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "/opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk 1073741824" returned: 0 in 0.089s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG nova.network.neutron [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Successfully created port: e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Cannot resize image /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Ensure instance console log exists: /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Successfully updated port: e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "refresh_cache-a8ade565-978b-4c2a-b205-99be6dba39cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquired lock "refresh_cache-a8ade565-978b-4c2a-b205-99be6dba39cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-changed-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Refreshing instance network info cache due to event network-changed-e6216837-04f4-48e0-9250-d59145aaea3c. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] Acquiring lock "refresh_cache-a8ade565-978b-4c2a-b205-99be6dba39cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Updating instance_info_cache with network_info: [{"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Releasing lock "refresh_cache-a8ade565-978b-4c2a-b205-99be6dba39cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Instance network_info: |[{"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] Acquired lock "refresh_cache-a8ade565-978b-4c2a-b205-99be6dba39cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Refreshing network info cache for port e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Start _get_guest_xml network_info=[{"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:51:16 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:16 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-21475602',display_name='tempest-VolumesAdminNegativeTest-server-21475602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-21475602',id=14,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9789163764134874a379056ee7cf142b',ramdisk_id='',reservation_id='r-uop1j8ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-403557302',owner_user_name='tempest-VolumesAdminNegativeTest-403557302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:15Z,user_data=None,user_id='d5d8a8463e6b44b5a49ada2835baf0d5',uuid=a8ade565-978b-4c2a-b205-99be6dba39cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converting VIF {"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.objects.instance [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'pci_devices' on Instance uuid a8ade565-978b-4c2a-b205-99be6dba39cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:51:16 user nova-compute[74582]:   <uuid>a8ade565-978b-4c2a-b205-99be6dba39cd</uuid>
Nov 03 13:51:16 user nova-compute[74582]:   <name>instance-0000000e</name>
Nov 03 13:51:16 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:51:16 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:51:16 user nova-compute[74582]:   <metadata>
Nov 03 13:51:16 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:51:16 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:51:16 user nova-compute[74582]:       <nova:name>tempest-VolumesAdminNegativeTest-server-21475602</nova:name>
Nov 03 13:51:16 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:51:16</nova:creationTime>
Nov 03 13:51:16 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:51:16 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:51:16 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:51:16 user nova-compute[74582]:       <nova:owner>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:user uuid="d5d8a8463e6b44b5a49ada2835baf0d5">tempest-VolumesAdminNegativeTest-403557302-project-member</nova:user>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:project uuid="9789163764134874a379056ee7cf142b">tempest-VolumesAdminNegativeTest-403557302</nova:project>
Nov 03 13:51:16 user nova-compute[74582]:       </nova:owner>
Nov 03 13:51:16 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:51:16 user nova-compute[74582]:       <nova:ports>
Nov 03 13:51:16 user nova-compute[74582]:         <nova:port uuid="e6216837-04f4-48e0-9250-d59145aaea3c">
Nov 03 13:51:16 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 13:51:16 user nova-compute[74582]:         </nova:port>
Nov 03 13:51:16 user nova-compute[74582]:       </nova:ports>
Nov 03 13:51:16 user nova-compute[74582]:     </nova:instance>
Nov 03 13:51:16 user nova-compute[74582]:   </metadata>
Nov 03 13:51:16 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:51:16 user nova-compute[74582]:     <system>
Nov 03 13:51:16 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:51:16 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:51:16 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:51:16 user nova-compute[74582]:       <entry name="serial">a8ade565-978b-4c2a-b205-99be6dba39cd</entry>
Nov 03 13:51:16 user nova-compute[74582]:       <entry name="uuid">a8ade565-978b-4c2a-b205-99be6dba39cd</entry>
Nov 03 13:51:16 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:51:16 user nova-compute[74582]:     </system>
Nov 03 13:51:16 user nova-compute[74582]:   </sysinfo>
Nov 03 13:51:16 user nova-compute[74582]:   <os>
Nov 03 13:51:16 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:51:16 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:51:16 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:51:16 user nova-compute[74582]:   </os>
Nov 03 13:51:16 user nova-compute[74582]:   <features>
Nov 03 13:51:16 user nova-compute[74582]:     <acpi/>
Nov 03 13:51:16 user nova-compute[74582]:     <apic/>
Nov 03 13:51:16 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:51:16 user nova-compute[74582]:   </features>
Nov 03 13:51:16 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:51:16 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:51:16 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:51:16 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:51:16 user nova-compute[74582]:   </clock>
Nov 03 13:51:16 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:51:16 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:51:16 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:51:16 user nova-compute[74582]:   </cpu>
Nov 03 13:51:16 user nova-compute[74582]:   <devices>
Nov 03 13:51:16 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:51:16 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:51:16 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk"/>
Nov 03 13:51:16 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:51:16 user nova-compute[74582]:     </disk>
Nov 03 13:51:16 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:51:16 user nova-compute[74582]:       <mac address="fa:16:3e:53:b1:ea"/>
Nov 03 13:51:16 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:51:16 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:51:16 user nova-compute[74582]:       <target dev="tape6216837-04"/>
Nov 03 13:51:16 user nova-compute[74582]:     </interface>
Nov 03 13:51:16 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:51:16 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/console.log" append="off"/>
Nov 03 13:51:16 user nova-compute[74582]:     </serial>
Nov 03 13:51:16 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:51:16 user nova-compute[74582]:     <video>
Nov 03 13:51:16 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:51:16 user nova-compute[74582]:     </video>
Nov 03 13:51:16 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:51:16 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:51:16 user nova-compute[74582]:     </rng>
Nov 03 13:51:16 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:51:16 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:51:16 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:51:16 user nova-compute[74582]:     </memballoon>
Nov 03 13:51:16 user nova-compute[74582]:   </devices>
Nov 03 13:51:16 user nova-compute[74582]: </domain>
Nov 03 13:51:16 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-21475602',display_name='tempest-VolumesAdminNegativeTest-server-21475602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-21475602',id=14,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9789163764134874a379056ee7cf142b',ramdisk_id='',reservation_id='r-uop1j8ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-403557302',owner_user_name='tempest-VolumesAdminNegativeTest-403557302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:15Z,user_data=None,user_id='d5d8a8463e6b44b5a49ada2835baf0d5',uuid=a8ade565-978b-4c2a-b205-99be6dba39cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converting VIF {"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG os_vif [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85fda333-cc0f-52db-b6e5-863b16295662', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6216837-04, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6216837-04, col_values=(('qos', UUID('ebeb86e5-507c-46ca-9344-e69311373a95')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6216837-04, col_values=(('external_ids', {'iface-id': 'e6216837-04f4-48e0-9250-d59145aaea3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b1:ea', 'vm-uuid': 'a8ade565-978b-4c2a-b205-99be6dba39cd'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:16 user nova-compute[74582]: INFO os_vif [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04')
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:51:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] No VIF found with MAC fa:16:3e:53:b1:ea, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG nova.network.neutron [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Updated VIF entry in instance network info cache for port e6216837-04f4-48e0-9250-d59145aaea3c. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG nova.network.neutron [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Updating instance_info_cache with network_info: [{"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8c526dc0-2dd8-49dd-a7a6-c87be0bccb42 req-1c9a9d9e-6fb4-4e68-bb15-a0457963fb89 service nova] Releasing lock "refresh_cache-a8ade565-978b-4c2a-b205-99be6dba39cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG os_brick.utils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f6026-ac00-48d0-baad-9c034f0ea113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57fe64d-3794-41da-90af-57cab374c23c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddf99d3-79f8-41f9-9e5c-2f7d652c268e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c359a398-7d4b-48fb-b715-3435868652fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:51:18 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e123e14-4221-4407-b37d-1ff428ae660c]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG os_brick.utils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating existing volume attachment record: ea9cfae6-03a3-444f-af61-0efb00b78b78 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-dc82c1e8-efff-4016-b328-9ed593d7fcdc req-49206dfa-2611-4609-8420-ec768d9393b1 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dc82c1e8-efff-4016-b328-9ed593d7fcdc req-49206dfa-2611-4609-8420-ec768d9393b1 service nova] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dc82c1e8-efff-4016-b328-9ed593d7fcdc req-49206dfa-2611-4609-8420-ec768d9393b1 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dc82c1e8-efff-4016-b328-9ed593d7fcdc req-49206dfa-2611-4609-8420-ec768d9393b1 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-dc82c1e8-efff-4016-b328-9ed593d7fcdc req-49206dfa-2611-4609-8420-ec768d9393b1 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] No waiting events found dispatching network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:18 user nova-compute[74582]: WARNING nova.compute.manager [req-dc82c1e8-efff-4016-b328-9ed593d7fcdc req-49206dfa-2611-4609-8420-ec768d9393b1 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received unexpected event network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c for instance with vm_state building and task_state spawning.
Nov 03 13:51:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-6c7ef172-e0e9-41df-9145-c5b8541475ec req-d4bb7132-65a3-4cdc-936f-77e56f526568 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6c7ef172-e0e9-41df-9145-c5b8541475ec req-d4bb7132-65a3-4cdc-936f-77e56f526568 service nova] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6c7ef172-e0e9-41df-9145-c5b8541475ec req-d4bb7132-65a3-4cdc-936f-77e56f526568 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6c7ef172-e0e9-41df-9145-c5b8541475ec req-d4bb7132-65a3-4cdc-936f-77e56f526568 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-6c7ef172-e0e9-41df-9145-c5b8541475ec req-d4bb7132-65a3-4cdc-936f-77e56f526568 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] No waiting events found dispatching network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:20 user nova-compute[74582]: WARNING nova.compute.manager [req-6c7ef172-e0e9-41df-9145-c5b8541475ec req-d4bb7132-65a3-4cdc-936f-77e56f526568 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received unexpected event network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c for instance with vm_state building and task_state spawning.
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:51:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Instance spawned successfully.
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:20 user nova-compute[74582]: INFO nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 03 13:51:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:51:20 user nova-compute[74582]: INFO nova.compute.manager [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Took 6.76 seconds to build instance.
Nov 03 13:51:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-da53cf89-b4c9-45a3-b5ac-7bb3bd86e32c tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.872s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:33 user nova-compute[74582]: WARNING nova.compute.manager [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Timeout waiting for ['volume-reimaged-97f5eb24-2bbe-41ee-afaf-2181e957bd36'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-97f5eb24-2bbe-41ee-afaf-2181e957bd36: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 03 13:51:33 user nova-compute[74582]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7f7f6872e260 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 03 13:51:33 user nova-compute[74582]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 03 13:51:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:33 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] swap_volume: Updating volume 6d4ea099-378f-4780-ba17-e4b94b8db8bc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vILERrCQ", "auth_password": "sJTj8HbtF4CNvd", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "46d7568c-7296-4fc2-bfc6-3492e919608a"}, "status": "reserved", "instance": "926114b3-1849-465b-94fb-3a1d6e49d56e", "attached_at": "", "detached_at": "", "volume_id": "46d7568c-7296-4fc2-bfc6-3492e919608a", "serial": "46d7568c-7296-4fc2-bfc6-3492e919608a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '46d7568c-7296-4fc2-bfc6-3492e919608a', 'no_device': None, 'attachment_id': '0f65be8d-89b3-4b80-89ed-55a991998f8a'} {{(pid=74582) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 03 13:51:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9cebd3ee-4e51-460b-8de6-42dfbb5acfc0 tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 52.248s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:33 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:51:33 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:34 user nova-compute[74582]: INFO nova.compute.manager [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Successfully reverted task state from rebuilding on failure for instance.
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server [None req-77fe0080-be3b-49cd-839c-58141066014d tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 03 13:51:34 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:34 user nova-compute[74582]: INFO nova.compute.manager [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Terminating instance
Nov 03 13:51:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG nova.compute.manager [req-f91d61c7-8c5a-452b-93ee-4157d8b58742 req-b065cb01-7239-4f2f-8abd-35b0a0591f45 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-vif-unplugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f91d61c7-8c5a-452b-93ee-4157d8b58742 req-b065cb01-7239-4f2f-8abd-35b0a0591f45 service nova] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f91d61c7-8c5a-452b-93ee-4157d8b58742 req-b065cb01-7239-4f2f-8abd-35b0a0591f45 service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f91d61c7-8c5a-452b-93ee-4157d8b58742 req-b065cb01-7239-4f2f-8abd-35b0a0591f45 service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG nova.compute.manager [req-f91d61c7-8c5a-452b-93ee-4157d8b58742 req-b065cb01-7239-4f2f-8abd-35b0a0591f45 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] No waiting events found dispatching network-vif-unplugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:34 user nova-compute[74582]: DEBUG nova.compute.manager [req-f91d61c7-8c5a-452b-93ee-4157d8b58742 req-b065cb01-7239-4f2f-8abd-35b0a0591f45 service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-vif-unplugged-042a8bde-8189-485c-90da-de4b304c57ac for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:51:35 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Instance destroyed successfully.
Nov 03 13:51:35 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lazy-loading 'resources' on Instance uuid a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-658368295',display_name='tempest-VolumesAssistedSnapshotsTest-server-658368295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-658368295',id=8,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrQSSO0guUkzW9e9gIy5RjSf5ZclQhv2NjbWOlVwem3AHXKZXnLP4GmBylOIRdZpsqLS/SmLaURQ0hw3wHu/WeofwUDOlDzQ06oKgAERivn1IMAsof/Y40WLOdmGlog4g==',key_name='tempest-keypair-1087529260',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f348ba8f4d64106978321c3830d41da',ramdisk_id='',reservation_id='r-524ep1cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1831984643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1831984643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc915d9d0264ad3bcecfc148b4fba43',uuid=a3eb9e0c-de33-4f7e-a7ab-cf46511353c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Converting VIF {"id": "042a8bde-8189-485c-90da-de4b304c57ac", "address": "fa:16:3e:c5:87:28", "network": {"id": "768601c8-fa40-46a4-abd7-6a5ae2ac22ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1709084290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f348ba8f4d64106978321c3830d41da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042a8bde-81", "ovs_interfaceid": "042a8bde-8189-485c-90da-de4b304c57ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG os_vif [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap042a8bde-81, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8279088b-c9ea-43b5-881e-4e3230651570) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:35 user nova-compute[74582]: INFO os_vif [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:87:28,bridge_name='br-int',has_traffic_filtering=True,id=042a8bde-8189-485c-90da-de4b304c57ac,network=Network(768601c8-fa40-46a4-abd7-6a5ae2ac22ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042a8bde-81')
Nov 03 13:51:35 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Deleting instance files /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8_del
Nov 03 13:51:35 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Deletion of /opt/stack/data/nova/instances/a3eb9e0c-de33-4f7e-a7ab-cf46511353c8_del complete
Nov 03 13:51:35 user nova-compute[74582]: INFO nova.compute.manager [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[79814d4d-85c4-4852-afba-d6933e45c2d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad74aa-7f39-4d6b-a952-40ca1ba8b595]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f32bf3-cf21-4b1d-97a4-c32316b1abb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[658fbf3d-06c0-4fd2-ba67-0c17aff8b413]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:51:35 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:51:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c565714-151d-42e6-922d-d58ad128c87d]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG os_brick.utils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:36 user nova-compute[74582]: INFO nova.compute.manager [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Swapping volume 46d7568c-7296-4fc2-bfc6-3492e919608a for 6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:51:36 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:36 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Took 1.06 seconds to deallocate network for instance.
Nov 03 13:51:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-400b2cf0-5b4f-4d42-b816-731e43564d04 req-e6b1042e-e4bc-4d00-bdc8-3dd0b667366f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-vif-deleted-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:36 user nova-compute[74582]: INFO nova.compute.manager [req-400b2cf0-5b4f-4d42-b816-731e43564d04 req-e6b1042e-e4bc-4d00-bdc8-3dd0b667366f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Neutron deleted interface 042a8bde-8189-485c-90da-de4b304c57ac; detaching it from the instance and deleting it from the info cache
Nov 03 13:51:36 user nova-compute[74582]: DEBUG nova.network.neutron [req-400b2cf0-5b4f-4d42-b816-731e43564d04 req-e6b1042e-e4bc-4d00-bdc8-3dd0b667366f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-400b2cf0-5b4f-4d42-b816-731e43564d04 req-e6b1042e-e4bc-4d00-bdc8-3dd0b667366f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Detach interface failed, port_id=042a8bde-8189-485c-90da-de4b304c57ac, reason: Instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-c7abb858-5def-4294-ace5-be77ddbf5402 req-585739ca-d52e-4811-9d7e-dbd6365afa8f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received event network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c7abb858-5def-4294-ace5-be77ddbf5402 req-585739ca-d52e-4811-9d7e-dbd6365afa8f service nova] Acquiring lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c7abb858-5def-4294-ace5-be77ddbf5402 req-585739ca-d52e-4811-9d7e-dbd6365afa8f service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c7abb858-5def-4294-ace5-be77ddbf5402 req-585739ca-d52e-4811-9d7e-dbd6365afa8f service nova] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-c7abb858-5def-4294-ace5-be77ddbf5402 req-585739ca-d52e-4811-9d7e-dbd6365afa8f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] No waiting events found dispatching network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:37 user nova-compute[74582]: WARNING nova.compute.manager [req-c7abb858-5def-4294-ace5-be77ddbf5402 req-585739ca-d52e-4811-9d7e-dbd6365afa8f service nova] [instance: a3eb9e0c-de33-4f7e-a7ab-cf46511353c8] Received unexpected event network-vif-plugged-042a8bde-8189-485c-90da-de4b304c57ac for instance with vm_state deleted and task_state None.
Nov 03 13:51:37 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:51:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:51:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:37 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Deleted allocations for instance a3eb9e0c-de33-4f7e-a7ab-cf46511353c8
Nov 03 13:51:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6099df62-80ad-45d8-964d-0895daac3e57 tempest-VolumesAssistedSnapshotsTest-1831984643 tempest-VolumesAssistedSnapshotsTest-1831984643-project-member] Lock "a3eb9e0c-de33-4f7e-a7ab-cf46511353c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-77fe0080-be3b-49cd-839c-58141066014d req-1377ee11-b650-4ac0-a26f-3981fdc15d28 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event volume-reimaged-97f5eb24-2bbe-41ee-afaf-2181e957bd36 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-77fe0080-be3b-49cd-839c-58141066014d req-1377ee11-b650-4ac0-a26f-3981fdc15d28 service nova] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-77fe0080-be3b-49cd-839c-58141066014d req-1377ee11-b650-4ac0-a26f-3981fdc15d28 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-77fe0080-be3b-49cd-839c-58141066014d req-1377ee11-b650-4ac0-a26f-3981fdc15d28 service nova] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-77fe0080-be3b-49cd-839c-58141066014d req-1377ee11-b650-4ac0-a26f-3981fdc15d28 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Processing event volume-reimaged-97f5eb24-2bbe-41ee-afaf-2181e957bd36 {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'pci_requests' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'numa_topology' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:51:39 user nova-compute[74582]: INFO nova.compute.claims [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Claim successful on node user
Nov 03 13:51:39 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:51:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:39 user nova-compute[74582]: INFO nova.network.neutron [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating port 7dc85b5b-09fc-488a-814e-40dc04da5ec2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquired lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-changed-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Refreshing instance network info cache due to event network-changed-7dc85b5b-09fc-488a-814e-40dc04da5ec2. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:51:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] Acquiring lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Releasing lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:51:41 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Creating image(s)
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] Acquired lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Refreshing network info cache for port 7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG nova.objects.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<e6a282d9-0ea3-431e-8df4-ffe5d8ae6823> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "4bb198e617922ed278599201be397e88d0debcf4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "4bb198e617922ed278599201be397e88d0debcf4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG nova.virt.images [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] 8064c43d-cd05-43a5-8fae-e412952a6122 was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.part /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updated VIF entry in instance network info cache for port 7dc85b5b-09fc-488a-814e-40dc04da5ec2. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f4d6ca84-0959-494f-978b-8047e2fd0ebf req-90051d18-0fdc-4b61-8724-72dc9f3add3a service nova] Releasing lock "refresh_cache-e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.part /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.converted" returned: 0 in 0.440s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "4bb198e617922ed278599201be397e88d0debcf4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.874s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "4bb198e617922ed278599201be397e88d0debcf4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "4bb198e617922ed278599201be397e88d0debcf4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4,backing_fmt=raw /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4,backing_fmt=raw /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk 1073741824" returned: 0 in 0.050s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "4bb198e617922ed278599201be397e88d0debcf4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'migration_context' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:43 user nova-compute[74582]: DEBUG nova.objects.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<e6a282d9-0ea3-431e-8df4-ffe5d8ae6823> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Rebasing disk image.
Nov 03 13:51:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 -F raw /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:51:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Creating image(s)
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Ensure instance console log exists: /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Start _get_guest_xml network_info=[{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea9cfae6-03a3-444f-af61-0efb00b78b78', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da0950d0-3380-4104-8dca-023612958b01', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9e21104-72e8-4171-8f72-2293706ab856', 'serial': 'c9e21104-72e8-4171-8f72-2293706ab856'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:51:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:44 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d944f1b3-4400-441c-b999-cbbce15ea6ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:51:44 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cfa445-634a-4c35-9c35-ca55d6212e97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856] added
Nov 03 13:51:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf34066c-2f69-4321-9df3-50bef934e1a6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d89ebc-c429-4016-9bce-f269291cc558]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfEkADGF {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfEkADGF" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670d571-57ef-45bd-bd6c-fa134f74683d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfEkADGF'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d81c1-715f-4c4d-b6b9-f3573b98964f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33dbecd-3c0c-4785-8528-319e2f22d23a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e2ffa-9888-48cb-94e1-bceca73f00d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260]
Nov 03 13:51:44 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260] successful.
Nov 03 13:51:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c9bb6d-a44a-46fa-be84-f6125058000a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ddf36-946c-44f7-85e6-0e8fff5345fd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff2faa-ac9d-4ef4-b1ba-98ae426534f8]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23061363131353239', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061363131353239', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-901676576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-901676576',id=13,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-rnq0c0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:07Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=da0950d0-3380-4104-8dca-023612958b01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'pci_devices' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:51:45 user nova-compute[74582]:   <uuid>da0950d0-3380-4104-8dca-023612958b01</uuid>
Nov 03 13:51:45 user nova-compute[74582]:   <name>instance-0000000d</name>
Nov 03 13:51:45 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:51:45 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:51:45 user nova-compute[74582]:   <metadata>
Nov 03 13:51:45 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:51:45 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:51:45 user nova-compute[74582]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-901676576</nova:name>
Nov 03 13:51:45 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:51:44</nova:creationTime>
Nov 03 13:51:45 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:51:45 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:51:45 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:51:45 user nova-compute[74582]:       <nova:owner>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:user uuid="e900eb8f4f6548f183010bc08a3c66f4">tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member</nova:user>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:project uuid="7bc44a2fb46b4a649544d7e506a2d96b">tempest-ServerBootFromVolumeStableRescueTest-412298968</nova:project>
Nov 03 13:51:45 user nova-compute[74582]:       </nova:owner>
Nov 03 13:51:45 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:51:45 user nova-compute[74582]:       <nova:ports>
Nov 03 13:51:45 user nova-compute[74582]:         <nova:port uuid="1609f201-4161-4c46-95a4-f307a062ee0f">
Nov 03 13:51:45 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 13:51:45 user nova-compute[74582]:         </nova:port>
Nov 03 13:51:45 user nova-compute[74582]:       </nova:ports>
Nov 03 13:51:45 user nova-compute[74582]:     </nova:instance>
Nov 03 13:51:45 user nova-compute[74582]:   </metadata>
Nov 03 13:51:45 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:51:45 user nova-compute[74582]:     <system>
Nov 03 13:51:45 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:51:45 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:51:45 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:51:45 user nova-compute[74582]:       <entry name="serial">da0950d0-3380-4104-8dca-023612958b01</entry>
Nov 03 13:51:45 user nova-compute[74582]:       <entry name="uuid">da0950d0-3380-4104-8dca-023612958b01</entry>
Nov 03 13:51:45 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:51:45 user nova-compute[74582]:     </system>
Nov 03 13:51:45 user nova-compute[74582]:   </sysinfo>
Nov 03 13:51:45 user nova-compute[74582]:   <os>
Nov 03 13:51:45 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:51:45 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:51:45 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:51:45 user nova-compute[74582]:   </os>
Nov 03 13:51:45 user nova-compute[74582]:   <features>
Nov 03 13:51:45 user nova-compute[74582]:     <acpi/>
Nov 03 13:51:45 user nova-compute[74582]:     <apic/>
Nov 03 13:51:45 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:51:45 user nova-compute[74582]:   </features>
Nov 03 13:51:45 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:51:45 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:51:45 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:51:45 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:51:45 user nova-compute[74582]:   </clock>
Nov 03 13:51:45 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:51:45 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:51:45 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:51:45 user nova-compute[74582]:   </cpu>
Nov 03 13:51:45 user nova-compute[74582]:   <devices>
Nov 03 13:51:45 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 13:51:45 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:51:45 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 13:51:45 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:51:45 user nova-compute[74582]:       <serial>c9e21104-72e8-4171-8f72-2293706ab856</serial>
Nov 03 13:51:45 user nova-compute[74582]:     </disk>
Nov 03 13:51:45 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:51:45 user nova-compute[74582]:       <mac address="fa:16:3e:56:8d:ac"/>
Nov 03 13:51:45 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:51:45 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:51:45 user nova-compute[74582]:       <target dev="tap1609f201-41"/>
Nov 03 13:51:45 user nova-compute[74582]:     </interface>
Nov 03 13:51:45 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:51:45 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/console.log" append="off"/>
Nov 03 13:51:45 user nova-compute[74582]:     </serial>
Nov 03 13:51:45 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:51:45 user nova-compute[74582]:     <video>
Nov 03 13:51:45 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:51:45 user nova-compute[74582]:     </video>
Nov 03 13:51:45 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:51:45 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:51:45 user nova-compute[74582]:     </rng>
Nov 03 13:51:45 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:51:45 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:51:45 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:51:45 user nova-compute[74582]:     </memballoon>
Nov 03 13:51:45 user nova-compute[74582]:   </devices>
Nov 03 13:51:45 user nova-compute[74582]: </domain>
Nov 03 13:51:45 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-901676576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-901676576',id=13,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-rnq0c0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:07Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=da0950d0-3380-4104-8dca-023612958b01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG os_vif [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '898fcd85-c642-5f7f-a259-63d792bf6f0a', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1609f201-41, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1609f201-41, col_values=(('qos', UUID('eb9bf58b-3e1d-4920-8313-3bc7fde3d706')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1609f201-41, col_values=(('external_ids', {'iface-id': '1609f201-4161-4c46-95a4-f307a062ee0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:8d:ac', 'vm-uuid': 'da0950d0-3380-4104-8dca-023612958b01'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:45 user nova-compute[74582]: INFO os_vif [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41')
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:51:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No VIF found with MAC fa:16:3e:56:8d:ac, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 -F raw /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk" returned: 0 in 2.255s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Ensure instance console log exists: /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Start _get_guest_xml network_info=[{"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='2eea4ec49cbae3ca9e71c77b103819bf',container_format='bare',created_at=2023-11-03T13:49:20Z,direct_url=<?>,disk_format='qcow2',id=8064c43d-cd05-43a5-8fae-e412952a6122,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-181316597-shelved',owner='9f1d4212d1484dd1b416342134f844e0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T13:49:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7a654423-024c-466e-b6c0-f2e6360e8d24', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCnqkJgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e6a282d9-0ea3-431e-8df4-ffe5d8ae6823', 'attached_at': '', 'detached_at': '', 'volume_id': '12775148-ce24-4d39-82d8-798cef96bb32', 'serial': '12775148-ce24-4d39-82d8-798cef96bb32'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:51:46 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:46 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2eea4ec49cbae3ca9e71c77b103819bf',container_format='bare',created_at=2023-11-03T13:49:20Z,direct_url=<?>,disk_format='qcow2',id=8064c43d-cd05-43a5-8fae-e412952a6122,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-181316597-shelved',owner='9f1d4212d1484dd1b416342134f844e0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T13:49:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.objects.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<e6a282d9-0ea3-431e-8df4-ffe5d8ae6823> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCnqkJgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:46 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:46 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:46 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260" returned: 21 in 0.041s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c821e1cd-bd98-40bd-ac68-8b1efe56db73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:51:46 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[477f9fc1-b5ad-40d4-b925-1a41d24d7571]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32] added
Nov 03 13:51:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[401afa74-cb87-4937-b4c5-ac27f1f72685]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bba43b-dc44-4dbb-a681-3bc7f3d20583]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCnqkJgI {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCnqkJgI" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[285613da-86e5-4591-907f-d6b008e1924f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tCnqkJgI'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a5de3-1740-4695-9f61-1d04df2b01a6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5537b9b-0a64-48c9-83f2-3c460e6afd93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b877c4c-c290-4eec-a101-195dd9cf709f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260]
Nov 03 13:51:46 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260] successful.
Nov 03 13:51:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6344772-040a-49d9-9305-e736d304c991]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ca09e5-701d-4b0e-8f9d-334238c59b94]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.195s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e2217d-7d7e-4994-85ab-c5873c58c47c]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCnqkJgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.621s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] <== connect_volume: return (1623ms) {'type': 'block', 'scsi_wwn': '23861306236373965', 'path': '/dev/sdf'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861306236373965', 'path': '/dev/sdf'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-181316597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-181316597',id=4,image_ref='8064c43d-cd05-43a5-8fae-e412952a6122',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-810171847',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-i93tzi7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member',shelved_at='2023-11-03T13:49:25.590933',shelved_host='user',shelved_image_id='8064c43d-cd05-43a5-8fae-e412952a6122'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=e6a282d9-0ea3-431e-8df4-ffe5d8ae6823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'pci_devices' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.objects.base [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<e6a282d9-0ea3-431e-8df4-ffe5d8ae6823> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:51:48 user nova-compute[74582]:   <uuid>e6a282d9-0ea3-431e-8df4-ffe5d8ae6823</uuid>
Nov 03 13:51:48 user nova-compute[74582]:   <name>instance-00000004</name>
Nov 03 13:51:48 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:51:48 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:51:48 user nova-compute[74582]:   <metadata>
Nov 03 13:51:48 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:51:48 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:51:48 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-181316597</nova:name>
Nov 03 13:51:48 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:51:46</nova:creationTime>
Nov 03 13:51:48 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:51:48 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:51:48 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:51:48 user nova-compute[74582]:       <nova:owner>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:user uuid="b2857caf27f24ebc895421391f498e01">tempest-AttachVolumeShelveTestJSON-1103257092-project-member</nova:user>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:project uuid="9f1d4212d1484dd1b416342134f844e0">tempest-AttachVolumeShelveTestJSON-1103257092</nova:project>
Nov 03 13:51:48 user nova-compute[74582]:       </nova:owner>
Nov 03 13:51:48 user nova-compute[74582]:       <nova:root type="image" uuid="8064c43d-cd05-43a5-8fae-e412952a6122"/>
Nov 03 13:51:48 user nova-compute[74582]:       <nova:ports>
Nov 03 13:51:48 user nova-compute[74582]:         <nova:port uuid="7dc85b5b-09fc-488a-814e-40dc04da5ec2">
Nov 03 13:51:48 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 13:51:48 user nova-compute[74582]:         </nova:port>
Nov 03 13:51:48 user nova-compute[74582]:       </nova:ports>
Nov 03 13:51:48 user nova-compute[74582]:     </nova:instance>
Nov 03 13:51:48 user nova-compute[74582]:   </metadata>
Nov 03 13:51:48 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:51:48 user nova-compute[74582]:     <system>
Nov 03 13:51:48 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:51:48 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:51:48 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:51:48 user nova-compute[74582]:       <entry name="serial">e6a282d9-0ea3-431e-8df4-ffe5d8ae6823</entry>
Nov 03 13:51:48 user nova-compute[74582]:       <entry name="uuid">e6a282d9-0ea3-431e-8df4-ffe5d8ae6823</entry>
Nov 03 13:51:48 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:51:48 user nova-compute[74582]:     </system>
Nov 03 13:51:48 user nova-compute[74582]:   </sysinfo>
Nov 03 13:51:48 user nova-compute[74582]:   <os>
Nov 03 13:51:48 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:51:48 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:51:48 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:51:48 user nova-compute[74582]:   </os>
Nov 03 13:51:48 user nova-compute[74582]:   <features>
Nov 03 13:51:48 user nova-compute[74582]:     <acpi/>
Nov 03 13:51:48 user nova-compute[74582]:     <apic/>
Nov 03 13:51:48 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:51:48 user nova-compute[74582]:   </features>
Nov 03 13:51:48 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:51:48 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:51:48 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:51:48 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:51:48 user nova-compute[74582]:   </clock>
Nov 03 13:51:48 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:51:48 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:51:48 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:51:48 user nova-compute[74582]:   </cpu>
Nov 03 13:51:48 user nova-compute[74582]:   <devices>
Nov 03 13:51:48 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:51:48 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:51:48 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk"/>
Nov 03 13:51:48 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:51:48 user nova-compute[74582]:     </disk>
Nov 03 13:51:48 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 13:51:48 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:51:48 user nova-compute[74582]:       <source dev="/dev/sdf"/>
Nov 03 13:51:48 user nova-compute[74582]:       <target dev="vdc" bus="virtio"/>
Nov 03 13:51:48 user nova-compute[74582]:       <serial>12775148-ce24-4d39-82d8-798cef96bb32</serial>
Nov 03 13:51:48 user nova-compute[74582]:     </disk>
Nov 03 13:51:48 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:51:48 user nova-compute[74582]:       <mac address="fa:16:3e:25:01:5f"/>
Nov 03 13:51:48 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:51:48 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:51:48 user nova-compute[74582]:       <target dev="tap7dc85b5b-09"/>
Nov 03 13:51:48 user nova-compute[74582]:     </interface>
Nov 03 13:51:48 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:51:48 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/console.log" append="off"/>
Nov 03 13:51:48 user nova-compute[74582]:     </serial>
Nov 03 13:51:48 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:51:48 user nova-compute[74582]:     <video>
Nov 03 13:51:48 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:51:48 user nova-compute[74582]:     </video>
Nov 03 13:51:48 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:51:48 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:51:48 user nova-compute[74582]:     </rng>
Nov 03 13:51:48 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:51:48 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:51:48 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:51:48 user nova-compute[74582]:     </memballoon>
Nov 03 13:51:48 user nova-compute[74582]:   </devices>
Nov 03 13:51:48 user nova-compute[74582]: </domain>
Nov 03 13:51:48 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-181316597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-181316597',id=4,image_ref='8064c43d-cd05-43a5-8fae-e412952a6122',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-810171847',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-i93tzi7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member',shelved_at='2023-11-03T13:49:25.590933',shelved_host='user',shelved_image_id='8064c43d-cd05-43a5-8fae-e412952a6122'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=e6a282d9-0ea3-431e-8df4-ffe5d8ae6823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG os_vif [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca01e8b8-336b-5d81-8637-78f37a4edfa3', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dc85b5b-09, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dc85b5b-09, col_values=(('qos', UUID('16e8eaac-c5b8-46f0-afec-65df0b08f593')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dc85b5b-09, col_values=(('external_ids', {'iface-id': '7dc85b5b-09fc-488a-814e-40dc04da5ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:01:5f', 'vm-uuid': 'e6a282d9-0ea3-431e-8df4-ffe5d8ae6823'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: INFO os_vif [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09')
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No VIF found with MAC fa:16:3e:25:01:5f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-84c56a4b-1f3b-4353-b64d-ccacf24914c0 req-0a5c9efe-fd2c-4716-8a42-5631903cd09b service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84c56a4b-1f3b-4353-b64d-ccacf24914c0 req-0a5c9efe-fd2c-4716-8a42-5631903cd09b service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84c56a4b-1f3b-4353-b64d-ccacf24914c0 req-0a5c9efe-fd2c-4716-8a42-5631903cd09b service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84c56a4b-1f3b-4353-b64d-ccacf24914c0 req-0a5c9efe-fd2c-4716-8a42-5631903cd09b service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-84c56a4b-1f3b-4353-b64d-ccacf24914c0 req-0a5c9efe-fd2c-4716-8a42-5631903cd09b service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:48 user nova-compute[74582]: WARNING nova.compute.manager [req-84c56a4b-1f3b-4353-b64d-ccacf24914c0 req-0a5c9efe-fd2c-4716-8a42-5631903cd09b service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state building and task_state spawning.
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-c9defdfa-5750-4145-870c-d4b4b427f333 req-e4eab9da-d8c3-49bf-b57c-afcccb89abeb service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c9defdfa-5750-4145-870c-d4b4b427f333 req-e4eab9da-d8c3-49bf-b57c-afcccb89abeb service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c9defdfa-5750-4145-870c-d4b4b427f333 req-e4eab9da-d8c3-49bf-b57c-afcccb89abeb service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c9defdfa-5750-4145-870c-d4b4b427f333 req-e4eab9da-d8c3-49bf-b57c-afcccb89abeb service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-c9defdfa-5750-4145-870c-d4b4b427f333 req-e4eab9da-d8c3-49bf-b57c-afcccb89abeb service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:50 user nova-compute[74582]: WARNING nova.compute.manager [req-c9defdfa-5750-4145-870c-d4b4b427f333 req-e4eab9da-d8c3-49bf-b57c-afcccb89abeb service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 13:51:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-17028f6c-7c99-470b-9eb5-980ab5abc33d req-66b37cd5-02d7-4dc6-b622-caf4284020fd service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-17028f6c-7c99-470b-9eb5-980ab5abc33d req-66b37cd5-02d7-4dc6-b622-caf4284020fd service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-17028f6c-7c99-470b-9eb5-980ab5abc33d req-66b37cd5-02d7-4dc6-b622-caf4284020fd service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-17028f6c-7c99-470b-9eb5-980ab5abc33d req-66b37cd5-02d7-4dc6-b622-caf4284020fd service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-17028f6c-7c99-470b-9eb5-980ab5abc33d req-66b37cd5-02d7-4dc6-b622-caf4284020fd service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:50 user nova-compute[74582]: WARNING nova.compute.manager [req-17028f6c-7c99-470b-9eb5-980ab5abc33d req-66b37cd5-02d7-4dc6-b622-caf4284020fd service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state building and task_state spawning.
Nov 03 13:51:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:51:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance spawned successfully.
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-002c95af-703c-49b1-9158-166b58ed6df9 req-b2ade97d-1455-4747-8a07-097f52ea35cd service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-002c95af-703c-49b1-9158-166b58ed6df9 req-b2ade97d-1455-4747-8a07-097f52ea35cd service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-002c95af-703c-49b1-9158-166b58ed6df9 req-b2ade97d-1455-4747-8a07-097f52ea35cd service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-002c95af-703c-49b1-9158-166b58ed6df9 req-b2ade97d-1455-4747-8a07-097f52ea35cd service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-002c95af-703c-49b1-9158-166b58ed6df9 req-b2ade97d-1455-4747-8a07-097f52ea35cd service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:51:52 user nova-compute[74582]: WARNING nova.compute.manager [req-002c95af-703c-49b1-9158-166b58ed6df9 req-b2ade97d-1455-4747-8a07-097f52ea35cd service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:52 user nova-compute[74582]: INFO nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Took 8.66 seconds to spawn the instance on the hypervisor.
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:51:52 user nova-compute[74582]: INFO nova.compute.manager [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Took 46.80 seconds to build instance.
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-189c8103-f171-4cca-95a6-35eec7408226 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "da0950d0-3380-4104-8dca-023612958b01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.983s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:51:53 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance spawned successfully.
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32a8f2e7-457e-466d-bc4b-cfc3a992ef56 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 40.956s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:55 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:55 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=25.405792236328125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 926114b3-1849-465b-94fb-3a1d6e49d56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b9636f0f-472d-40f5-bb99-3c11296ba1c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a8ade565-978b-4c2a-b205-99be6dba39cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:51:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:51:56 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:51:56 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:51:56 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:51:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:51:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:51:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'info_cache' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:57 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance destroyed successfully.
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'resources' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b20a9c0-1c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c9037c3-3ea7-4a4e-9d39-ddd9c8d19f4a) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:51:58 user nova-compute[74582]: INFO os_vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c')
Nov 03 13:51:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:58 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3005e1b-7877-4fc3-93ed-2264051848c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:51:58 user nova-compute[74582]: No targets found.
Nov 03 13:51:58 user nova-compute[74582]: iSNS:
Nov 03 13:51:58 user nova-compute[74582]: No targets found.
Nov 03 13:51:58 user nova-compute[74582]: STATIC:
Nov 03 13:51:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:51:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32
Nov 03 13:51:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a
Nov 03 13:51:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:51:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:51:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:51:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:51:58 user nova-compute[74582]: FIRMWARE:
Nov 03 13:51:58 user nova-compute[74582]: No targets found.
Nov 03 13:51:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:51:58 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:51:58 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca4f6bb-0d37-437e-a1be-78b9bada888e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcc46d2-a5a5-4176-8f00-a320236d0b57]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f6830a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b838e81-ea0e-4c7d-8c3d-b7922e2bb189]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8374e4-a39d-461a-be1f-cbb5a37128d3]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a011942e-4c96-4c1e-a532-fd1506ec818e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.104s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fdbeed-1c94-4ecb-9190-4a41abd18b79]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4978373-fa8983aa7f70c477', '/dev/disk/by-id/scsi-26661383938336161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4978373') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 13:51:58 user nova-compute[74582]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4978373-fa8983aa7f70c477
Nov 03 13:51:58 user nova-compute[74582]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26661383938336161
Nov 03 13:51:58 user nova-compute[74582]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4978373
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87cbc0b-d7f2-4749-9001-676df56f57f5]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c1e121-56ea-4fd8-b4f5-a2c4c4015331]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaada815-15ef-44be-9e02-12b4500aa965]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]
Nov 03 13:51:59 user nova-compute[74582]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0013049-7c28-4846-afcf-10280d70f646]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== disconnect_volume: return (459ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start _get_guest_xml network_info=[{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b53d0fc9-108c-46ab-b9d0-eb700beef32b', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0795b1b5-b17d-4cbd-ba36-f8a4de7083c2', 'attached_at': '', 'detached_at': '', 'volume_id': '7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'serial': '7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'numa_topology' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:59 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:59 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:51:59 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:59 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:51:59 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[560d46d5-02f0-4a47-8624-2b3b7e2237f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:51:59 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f49d7-9ce6-417b-b967-cee1a5bbbb6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9] added
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd9629-6824-42ff-8a5f-f37d6cfe72c4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5920f-c21b-4e9c-9ca2-0073c2556c1c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdckBawx {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdckBawx" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[723632c6-3f1f-4e11-990f-40b20a017bb8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdckBawx'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd0da61-1211-468c-addf-18a136af7a77]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f1c17f-613a-4c43-af65-f66fd37a1e50]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c07c595-a725-4dc0-ade4-2ab2de0a44e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]
Nov 03 13:51:59 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8947b00b-20ca-4802-8245-11048e4ed179]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5837db-ecb6-4e4b-a89c-1791685e9308]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:51:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b72775-f53e-40b5-b2bd-15183ed6b5ae]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating instance_info_cache with network_info: [{"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-1294e014-eed1-4016-a1a4-c3977799f4d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:51:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-changed-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Refreshing instance network info cache due to event network-changed-69a43c35-3a4e-4316-91dd-061c62542fb8. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] Acquiring lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] Acquired lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Refreshing network info cache for port 69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26661383938336161', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383938336161', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'pci_devices' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:52:00 user nova-compute[74582]:   <uuid>0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</uuid>
Nov 03 13:52:00 user nova-compute[74582]:   <name>instance-00000003</name>
Nov 03 13:52:00 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:52:00 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:52:00 user nova-compute[74582]:   <metadata>
Nov 03 13:52:00 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:52:00 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:52:00 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeTestJSON-server-2072902535</nova:name>
Nov 03 13:52:00 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:51:59</nova:creationTime>
Nov 03 13:52:00 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:52:00 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:52:00 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:52:00 user nova-compute[74582]:       <nova:owner>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:user uuid="9ee2e8967900436e874e86e6dd64ce72">tempest-AttachVolumeTestJSON-331837995-project-member</nova:user>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:project uuid="867ccc345ce547daa6a83fe5f13c74b7">tempest-AttachVolumeTestJSON-331837995</nova:project>
Nov 03 13:52:00 user nova-compute[74582]:       </nova:owner>
Nov 03 13:52:00 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:52:00 user nova-compute[74582]:       <nova:ports>
Nov 03 13:52:00 user nova-compute[74582]:         <nova:port uuid="2b20a9c0-1c23-4a40-96fc-722cb901bf56">
Nov 03 13:52:00 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:52:00 user nova-compute[74582]:         </nova:port>
Nov 03 13:52:00 user nova-compute[74582]:       </nova:ports>
Nov 03 13:52:00 user nova-compute[74582]:     </nova:instance>
Nov 03 13:52:00 user nova-compute[74582]:   </metadata>
Nov 03 13:52:00 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:52:00 user nova-compute[74582]:     <system>
Nov 03 13:52:00 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:52:00 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:52:00 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:52:00 user nova-compute[74582]:       <entry name="serial">0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</entry>
Nov 03 13:52:00 user nova-compute[74582]:       <entry name="uuid">0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</entry>
Nov 03 13:52:00 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:52:00 user nova-compute[74582]:     </system>
Nov 03 13:52:00 user nova-compute[74582]:   </sysinfo>
Nov 03 13:52:00 user nova-compute[74582]:   <os>
Nov 03 13:52:00 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:52:00 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:52:00 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:52:00 user nova-compute[74582]:   </os>
Nov 03 13:52:00 user nova-compute[74582]:   <features>
Nov 03 13:52:00 user nova-compute[74582]:     <acpi/>
Nov 03 13:52:00 user nova-compute[74582]:     <apic/>
Nov 03 13:52:00 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:52:00 user nova-compute[74582]:   </features>
Nov 03 13:52:00 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:52:00 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:52:00 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:52:00 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:52:00 user nova-compute[74582]:   </clock>
Nov 03 13:52:00 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:52:00 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:52:00 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:52:00 user nova-compute[74582]:   </cpu>
Nov 03 13:52:00 user nova-compute[74582]:   <devices>
Nov 03 13:52:00 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:52:00 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:52:00 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk"/>
Nov 03 13:52:00 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:52:00 user nova-compute[74582]:     </disk>
Nov 03 13:52:00 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 13:52:00 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:52:00 user nova-compute[74582]:       <source dev="/dev/sdd"/>
Nov 03 13:52:00 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 13:52:00 user nova-compute[74582]:       <serial>7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9</serial>
Nov 03 13:52:00 user nova-compute[74582]:     </disk>
Nov 03 13:52:00 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:52:00 user nova-compute[74582]:       <mac address="fa:16:3e:75:8e:a5"/>
Nov 03 13:52:00 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:52:00 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:52:00 user nova-compute[74582]:       <target dev="tap2b20a9c0-1c"/>
Nov 03 13:52:00 user nova-compute[74582]:     </interface>
Nov 03 13:52:00 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:52:00 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/console.log" append="off"/>
Nov 03 13:52:00 user nova-compute[74582]:     </serial>
Nov 03 13:52:00 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:52:00 user nova-compute[74582]:     <video>
Nov 03 13:52:00 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:52:00 user nova-compute[74582]:     </video>
Nov 03 13:52:00 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:52:00 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:52:00 user nova-compute[74582]:     </rng>
Nov 03 13:52:00 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:52:00 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:52:00 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:52:00 user nova-compute[74582]:     </memballoon>
Nov 03 13:52:00 user nova-compute[74582]:   </devices>
Nov 03 13:52:00 user nova-compute[74582]: </domain>
Nov 03 13:52:00 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Updated VIF entry in instance network info cache for port 69a43c35-3a4e-4316-91dd-061c62542fb8. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Updating instance_info_cache with network_info: [{"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:52:00 user nova-compute[74582]: INFO nova.compute.manager [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Terminating instance
Nov 03 13:52:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe572e84-7fb2-49fd-84d6-bb8990fe54e5 req-60eb61dc-1e72-46fd-aec1-35e19e1b1236 service nova] Releasing lock "refresh_cache-b9636f0f-472d-40f5-bb99-3c11296ba1c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-3d743be4-29d8-49b0-a638-d7fa6379a538 req-44b4ac8e-1a9b-4cae-afc0-f2be97ca7fc0 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-unplugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3d743be4-29d8-49b0-a638-d7fa6379a538 req-44b4ac8e-1a9b-4cae-afc0-f2be97ca7fc0 service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3d743be4-29d8-49b0-a638-d7fa6379a538 req-44b4ac8e-1a9b-4cae-afc0-f2be97ca7fc0 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3d743be4-29d8-49b0-a638-d7fa6379a538 req-44b4ac8e-1a9b-4cae-afc0-f2be97ca7fc0 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-3d743be4-29d8-49b0-a638-d7fa6379a538 req-44b4ac8e-1a9b-4cae-afc0-f2be97ca7fc0 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-unplugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-3d743be4-29d8-49b0-a638-d7fa6379a538 req-44b4ac8e-1a9b-4cae-afc0-f2be97ca7fc0 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-unplugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Cannot resize image /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'migration_context' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.objects.base [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG os_vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f61105e-5a86-5752-b234-3c34893df8ad', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Instance destroyed successfully.
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'resources' on Instance uuid b9636f0f-472d-40f5-bb99-3c11296ba1c5 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b20a9c0-1c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b20a9c0-1c, col_values=(('qos', UUID('d289bf93-3bcb-4d83-bfc3-aee36864f2dc')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b20a9c0-1c, col_values=(('external_ids', {'iface-id': '2b20a9c0-1c23-4a40-96fc-722cb901bf56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:8e:a5', 'vm-uuid': '0795b1b5-b17d-4cbd-ba36-f8a4de7083c2'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1963385228',display_name='tempest-AttachVolumeNegativeTest-server-1963385228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1963385228',id=12,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa3xP7/sxvwxS9UvK3LGvqgSVMT6MBKIi5YereHLVNp2dXY1b8Sgr9KnUMD59onTk4kA5haNgVLKbk+n+X19m5thLjSaNYsnU7PL15yWWipfHuzlmp33g3I5RMCC/6m4g==',key_name='tempest-keypair-666006040',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-1bc580p8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:50:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=b9636f0f-472d-40f5-bb99-3c11296ba1c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "69a43c35-3a4e-4316-91dd-061c62542fb8", "address": "fa:16:3e:e3:6d:19", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a43c35-3a", "ovs_interfaceid": "69a43c35-3a4e-4316-91dd-061c62542fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG os_vif [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: INFO os_vif [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c')
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69a43c35-3a, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc34d0bb-e9ec-4042-aa49-f7b1afcf6733) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:01 user nova-compute[74582]: INFO os_vif [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=69a43c35-3a4e-4316-91dd-061c62542fb8,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a43c35-3a')
Nov 03 13:52:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Deleting instance files /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5_del
Nov 03 13:52:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Deletion of /opt/stack/data/nova/instances/b9636f0f-472d-40f5-bb99-3c11296ba1c5_del complete
Nov 03 13:52:01 user nova-compute[74582]: INFO nova.compute.manager [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 03 13:52:01 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:52:01 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:52:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:03 user nova-compute[74582]: WARNING nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state active and task_state deleting.
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:03 user nova-compute[74582]: WARNING nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state active and task_state deleting.
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:03 user nova-compute[74582]: WARNING nova.compute.manager [req-fcd7e2d9-db00-4920-b073-5a2e6ebb0f7c req-bc87a67a-52e0-44c4-a63a-265a858b302e service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state active and task_state deleting.
Nov 03 13:52:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:52:03 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Took 1.85 seconds to deallocate network for instance.
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-cb981f28-8661-4838-8b22-a710d61669fb req-0bb70fed-2925-4aa3-99ec-4174e66ee1de service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb981f28-8661-4838-8b22-a710d61669fb req-0bb70fed-2925-4aa3-99ec-4174e66ee1de service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb981f28-8661-4838-8b22-a710d61669fb req-0bb70fed-2925-4aa3-99ec-4174e66ee1de service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb981f28-8661-4838-8b22-a710d61669fb req-0bb70fed-2925-4aa3-99ec-4174e66ee1de service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-cb981f28-8661-4838-8b22-a710d61669fb req-0bb70fed-2925-4aa3-99ec-4174e66ee1de service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:04 user nova-compute[74582]: WARNING nova.compute.manager [req-cb981f28-8661-4838-8b22-a710d61669fb req-0bb70fed-2925-4aa3-99ec-4174e66ee1de service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state stopped and task_state powering-on.
Nov 03 13:52:04 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:04 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Deleted allocations for instance b9636f0f-472d-40f5-bb99-3c11296ba1c5
Nov 03 13:52:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6024a086-4444-44a8-88e7-adb09d2eecaa tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.895s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-unplugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-unplugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:05 user nova-compute[74582]: WARNING nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-unplugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state deleted and task_state None.
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] Acquiring lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] Lock "b9636f0f-472d-40f5-bb99-3c11296ba1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] No waiting events found dispatching network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:05 user nova-compute[74582]: WARNING nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received unexpected event network-vif-plugged-69a43c35-3a4e-4316-91dd-061c62542fb8 for instance with vm_state deleted and task_state None.
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-a8b172e9-ac1e-4e58-90af-badc1bce173b req-9075d024-1a1b-4fa9-b6d4-e3a269b8e433 service nova] [instance: b9636f0f-472d-40f5-bb99-3c11296ba1c5] Received event network-vif-deleted-69a43c35-3a4e-4316-91dd-061c62542fb8 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:52:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance rebooted successfully.
Nov 03 13:52:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d250d16d-59f5-45bb-9d47-d2ffa3f34dc4 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:52:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-896459f4-6cce-4d10-b2de-2134642dd345 req-4cf5c805-9a85-46ea-b966-2288f1548c8e service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-896459f4-6cce-4d10-b2de-2134642dd345 req-4cf5c805-9a85-46ea-b966-2288f1548c8e service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-896459f4-6cce-4d10-b2de-2134642dd345 req-4cf5c805-9a85-46ea-b966-2288f1548c8e service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-896459f4-6cce-4d10-b2de-2134642dd345 req-4cf5c805-9a85-46ea-b966-2288f1548c8e service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-896459f4-6cce-4d10-b2de-2134642dd345 req-4cf5c805-9a85-46ea-b966-2288f1548c8e service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:06 user nova-compute[74582]: WARNING nova.compute.manager [req-896459f4-6cce-4d10-b2de-2134642dd345 req-4cf5c805-9a85-46ea-b966-2288f1548c8e service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state active and task_state None.
Nov 03 13:52:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:52:08 user nova-compute[74582]: INFO nova.compute.claims [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Claim successful on node user
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:52:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.policy [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aff1acfbf504e3ca9fadaf662314da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d23e2540d949c28d9db7cffe3157ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:52:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Creating image(s)
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "/opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.013s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "/opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.056s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.254s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.238s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk 1073741824" returned: 0 in 0.066s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Successfully created port: 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:52:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Cannot resize image /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Ensure instance console log exists: /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Successfully updated port: 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-changed-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Refreshing instance network info cache due to event network-changed-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Instance network_info: |[{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.neutron [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Refreshing network info cache for port 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Start _get_guest_xml network_info=[{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:52:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:52:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268045556',display_name='tempest-ServerActionsTestOtherA-server-268045556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268045556',id=15,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-qta450zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=6c2a8ccb-6b67-457c-bd6e-2c93161315e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:52:10 user nova-compute[74582]:   <uuid>6c2a8ccb-6b67-457c-bd6e-2c93161315e3</uuid>
Nov 03 13:52:10 user nova-compute[74582]:   <name>instance-0000000f</name>
Nov 03 13:52:10 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:52:10 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:52:10 user nova-compute[74582]:   <metadata>
Nov 03 13:52:10 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:52:10 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:52:10 user nova-compute[74582]:       <nova:name>tempest-ServerActionsTestOtherA-server-268045556</nova:name>
Nov 03 13:52:10 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:52:10</nova:creationTime>
Nov 03 13:52:10 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:52:10 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:52:10 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:52:10 user nova-compute[74582]:       <nova:owner>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:user uuid="1aff1acfbf504e3ca9fadaf662314da0">tempest-ServerActionsTestOtherA-1486248520-project-member</nova:user>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:project uuid="89d23e2540d949c28d9db7cffe3157ac">tempest-ServerActionsTestOtherA-1486248520</nova:project>
Nov 03 13:52:10 user nova-compute[74582]:       </nova:owner>
Nov 03 13:52:10 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:52:10 user nova-compute[74582]:       <nova:ports>
Nov 03 13:52:10 user nova-compute[74582]:         <nova:port uuid="400ba332-96ca-4bf2-9c81-f2a4acd7c6a9">
Nov 03 13:52:10 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 13:52:10 user nova-compute[74582]:         </nova:port>
Nov 03 13:52:10 user nova-compute[74582]:       </nova:ports>
Nov 03 13:52:10 user nova-compute[74582]:     </nova:instance>
Nov 03 13:52:10 user nova-compute[74582]:   </metadata>
Nov 03 13:52:10 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:52:10 user nova-compute[74582]:     <system>
Nov 03 13:52:10 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:52:10 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:52:10 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:52:10 user nova-compute[74582]:       <entry name="serial">6c2a8ccb-6b67-457c-bd6e-2c93161315e3</entry>
Nov 03 13:52:10 user nova-compute[74582]:       <entry name="uuid">6c2a8ccb-6b67-457c-bd6e-2c93161315e3</entry>
Nov 03 13:52:10 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:52:10 user nova-compute[74582]:     </system>
Nov 03 13:52:10 user nova-compute[74582]:   </sysinfo>
Nov 03 13:52:10 user nova-compute[74582]:   <os>
Nov 03 13:52:10 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:52:10 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:52:10 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:52:10 user nova-compute[74582]:   </os>
Nov 03 13:52:10 user nova-compute[74582]:   <features>
Nov 03 13:52:10 user nova-compute[74582]:     <acpi/>
Nov 03 13:52:10 user nova-compute[74582]:     <apic/>
Nov 03 13:52:10 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:52:10 user nova-compute[74582]:   </features>
Nov 03 13:52:10 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:52:10 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:52:10 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:52:10 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:52:10 user nova-compute[74582]:   </clock>
Nov 03 13:52:10 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:52:10 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:52:10 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:52:10 user nova-compute[74582]:   </cpu>
Nov 03 13:52:10 user nova-compute[74582]:   <devices>
Nov 03 13:52:10 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:52:10 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:52:10 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk"/>
Nov 03 13:52:10 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:52:10 user nova-compute[74582]:     </disk>
Nov 03 13:52:10 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:52:10 user nova-compute[74582]:       <mac address="fa:16:3e:74:da:4e"/>
Nov 03 13:52:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:52:10 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:52:10 user nova-compute[74582]:       <target dev="tap400ba332-96"/>
Nov 03 13:52:10 user nova-compute[74582]:     </interface>
Nov 03 13:52:10 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:52:10 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/console.log" append="off"/>
Nov 03 13:52:10 user nova-compute[74582]:     </serial>
Nov 03 13:52:10 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:52:10 user nova-compute[74582]:     <video>
Nov 03 13:52:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:52:10 user nova-compute[74582]:     </video>
Nov 03 13:52:10 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:52:10 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:52:10 user nova-compute[74582]:     </rng>
Nov 03 13:52:10 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:52:10 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:52:10 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:52:10 user nova-compute[74582]:     </memballoon>
Nov 03 13:52:10 user nova-compute[74582]:   </devices>
Nov 03 13:52:10 user nova-compute[74582]: </domain>
Nov 03 13:52:10 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268045556',display_name='tempest-ServerActionsTestOtherA-server-268045556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268045556',id=15,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-qta450zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=6c2a8ccb-6b67-457c-bd6e-2c93161315e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG os_vif [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57e2ffc3-0ad5-5eec-aa14-9a8bc2afd370', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap400ba332-96, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap400ba332-96, col_values=(('qos', UUID('1ead5214-386e-4bd8-b6c6-3cbd02a8bd7d')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap400ba332-96, col_values=(('external_ids', {'iface-id': '400ba332-96ca-4bf2-9c81-f2a4acd7c6a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:da:4e', 'vm-uuid': '6c2a8ccb-6b67-457c-bd6e-2c93161315e3'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:10 user nova-compute[74582]: INFO os_vif [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96')
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:52:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No VIF found with MAC fa:16:3e:74:da:4e, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:52:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated VIF entry in instance network info cache for port 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:52:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:52:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5c51fbd8-e00b-4680-bebf-befc646962fe req-e449e7ca-8509-4a67-82d7-a8e83d50c54f service nova] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-988ef297-f7de-42ba-ac98-c8b395ab1ff6 req-b24d33cb-ede8-4b7d-9c97-2df10186610f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-988ef297-f7de-42ba-ac98-c8b395ab1ff6 req-b24d33cb-ede8-4b7d-9c97-2df10186610f service nova] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-988ef297-f7de-42ba-ac98-c8b395ab1ff6 req-b24d33cb-ede8-4b7d-9c97-2df10186610f service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-988ef297-f7de-42ba-ac98-c8b395ab1ff6 req-b24d33cb-ede8-4b7d-9c97-2df10186610f service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-988ef297-f7de-42ba-ac98-c8b395ab1ff6 req-b24d33cb-ede8-4b7d-9c97-2df10186610f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] No waiting events found dispatching network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:12 user nova-compute[74582]: WARNING nova.compute.manager [req-988ef297-f7de-42ba-ac98-c8b395ab1ff6 req-b24d33cb-ede8-4b7d-9c97-2df10186610f service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received unexpected event network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 for instance with vm_state building and task_state spawning.
Nov 03 13:52:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-cb125cfc-5a86-485d-8641-432460796e4b req-2c512562-2527-4abf-84b8-b3224198691b service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb125cfc-5a86-485d-8641-432460796e4b req-2c512562-2527-4abf-84b8-b3224198691b service nova] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb125cfc-5a86-485d-8641-432460796e4b req-2c512562-2527-4abf-84b8-b3224198691b service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb125cfc-5a86-485d-8641-432460796e4b req-2c512562-2527-4abf-84b8-b3224198691b service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-cb125cfc-5a86-485d-8641-432460796e4b req-2c512562-2527-4abf-84b8-b3224198691b service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] No waiting events found dispatching network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:14 user nova-compute[74582]: WARNING nova.compute.manager [req-cb125cfc-5a86-485d-8641-432460796e4b req-2c512562-2527-4abf-84b8-b3224198691b service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received unexpected event network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 for instance with vm_state building and task_state spawning.
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:52:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Instance spawned successfully.
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:52:14 user nova-compute[74582]: INFO nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 03 13:52:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:52:15 user nova-compute[74582]: INFO nova.compute.manager [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Took 7.07 seconds to build instance.
Nov 03 13:52:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c651c413-5d11-48d9-a2ec-ca88595f6abe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.175s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 13:52:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 0 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 13:52:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:48 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:48 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:52:48 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '926114b3-1849-465b-94fb-3a1d6e49d56e', 'attached_at': '', 'detached_at': '', 'volume_id': '6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'serial': '6d4ea099-378f-4780-ba17-e4b94b8db8bc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vILERrCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '46d7568c-7296-4fc2-bfc6-3492e919608a'}, 'status': 'reserved', 'instance': '926114b3-1849-465b-94fb-3a1d6e49d56e', 'attached_at': '', 'detached_at': '', 'volume_id': '46d7568c-7296-4fc2-bfc6-3492e919608a', 'serial'} {{(pid=74582) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:52:51 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:52:51 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:52:51 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[538f3c62-1252-4e69-b860-da3d2ebf8018]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:52:51 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[01edf114-8fb8-454c-b567-5c90df5561c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc] added
Nov 03 13:52:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ebda15-5e76-459f-a52b-6177b3396b2b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb45ba-6340-4b17-af5c-891e9fd7e85f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v djbgVeMS {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v djbgVeMS" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8294ebe8-ec9a-44d6-8fc8-aa18af2d75b2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'djbgVeMS'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef4e77b-9459-4bb0-bd1d-73d42de01d37]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f45a0f6-8579-4735-91cb-0626e14d87cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:52:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --login" returned: 0 in 1.099s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b91a50-4d7c-4127-9b96-16bdad53644c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]
Nov 03 13:52:52 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.
Nov 03 13:52:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: INFO nova.compute.manager [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Detaching volume 89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb305dc-8852-4d51-83ad-49f0460ca84a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15aedec-8bbf-4263-a883-73cd19613abb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:52:52 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:52:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.488s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] HCTL ('38', '-', '-', 0) found on session 15 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc65564-85f2-4884-a5ee-0a18af133ae5]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:52:52 user nova-compute[74582]: INFO nova.virt.block_device [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Attempting to driver detach volume 89a157de-3dd0-4dcb-8a42-f49d19ec2712 from mountpoint /dev/vdb
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Attempting to detach device vdb from instance 02c8e503-1dce-4a76-adc7-93b3f04985ce from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:52:53 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:52:53 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:52:53 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:52:53 user nova-compute[74582]:   <serial>89a157de-3dd0-4dcb-8a42-f49d19ec2712</serial>
Nov 03 13:52:53 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:52:53 user nova-compute[74582]: </disk>
Nov 03 13:52:53 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:52:53 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully detached device vdb from instance 02c8e503-1dce-4a76-adc7-93b3f04985ce from the persistent domain config.
Nov 03 13:52:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02c8e503-1dce-4a76-adc7-93b3f04985ce from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:52:53 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:52:53 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:52:53 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:52:53 user nova-compute[74582]:   <serial>89a157de-3dd0-4dcb-8a42-f49d19ec2712</serial>
Nov 03 13:52:53 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:52:53 user nova-compute[74582]: </disk>
Nov 03 13:52:53 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.776s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] <== connect_volume: return (2778ms) {'type': 'block', 'scsi_wwn': '23264393462363962', 'path': '/dev/sdg'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264393462363962', 'path': '/dev/sdg'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:52:54 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:52:54 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.487525939941406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lazy-loading 'flavor' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 926114b3-1849-465b-94fb-3a1d6e49d56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a8ade565-978b-4c2a-b205-99be6dba39cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 13:52:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 108003328 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.267s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 244318208 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 341835776 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 473956352 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:52:56 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 608174080 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:52:57 user nova-compute[74582]: INFO nova.compute.manager [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Rescuing
Nov 03 13:52:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:52:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 717225984 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 878706688 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 1046478848 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-92f7d4f0-21bb-49a2-82a2-8a4eb1d40af8 req-fc3e99be-983e-4eb5-9a57-cce4c023875f service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-92f7d4f0-21bb-49a2-82a2-8a4eb1d40af8 req-fc3e99be-983e-4eb5-9a57-cce4c023875f service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-92f7d4f0-21bb-49a2-82a2-8a4eb1d40af8 req-fc3e99be-983e-4eb5-9a57-cce4c023875f service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-92f7d4f0-21bb-49a2-82a2-8a4eb1d40af8 req-fc3e99be-983e-4eb5-9a57-cce4c023875f service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-92f7d4f0-21bb-49a2-82a2-8a4eb1d40af8 req-fc3e99be-983e-4eb5-9a57-cce4c023875f service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:52:59 user nova-compute[74582]: WARNING nova.compute.manager [req-92f7d4f0-21bb-49a2-82a2-8a4eb1d40af8 req-fc3e99be-983e-4eb5-9a57-cce4c023875f service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state active and task_state rescuing.
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:52:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance destroyed successfully.
Nov 03 13:52:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Attempting a stable device rescue
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vILERrCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '46d7568c-7296-4fc2-bfc6-3492e919608a'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:52:59 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74582) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e1606f-4f2b-4854-b904-0ca7569ea8a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:52:59 user nova-compute[74582]: No targets found.
Nov 03 13:52:59 user nova-compute[74582]: iSNS:
Nov 03 13:52:59 user nova-compute[74582]: No targets found.
Nov 03 13:52:59 user nova-compute[74582]: STATIC:
Nov 03 13:52:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:52:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:52:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:52:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32
Nov 03 13:52:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:52:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:52:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a
Nov 03 13:52:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:52:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:52:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:52:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:52:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:52:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:52:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:52:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:52:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:52:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:52:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:52:59 user nova-compute[74582]: FIRMWARE:
Nov 03 13:52:59 user nova-compute[74582]: No targets found.
Nov 03 13:52:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:52:59 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:52:59 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 13:52:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Creating image(s)
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "/opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'trusted_certs' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69802bd-7cc2-46d0-a102-0412a011f99e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "6a62550edfef7c468bacef6481a709c249f287b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "6a62550edfef7c468bacef6481a709c249f287b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc5114-f379-4893-89ec-70da8876aca4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:52:59 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:52:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683e2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a'): ({'sde'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Removing single pathed devices sde {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dec80f1-eebc-43f3-bc03-d4b7cefe0169]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[72815088-33e6-4a0d-8a3e-e83f45361f0c]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Flushing IO for device /dev/sde {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:52:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5df4b9-766b-4df6-9ff2-90567e1e138c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f137eb1-6354-4b09-a081-6d0ba85b3c69]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b6e75-f21a-4043-884b-d2af0260b71f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG nova.virt.images [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] b495ee9a-5dcd-4330-917d-22a4caeaafe1 was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:53:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.part /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e7ec3-4f9f-4666-bfc3-a66d6842bb24]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260]
Nov 03 13:53:01 user nova-compute[74582]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a, portal: 172.16.0.220,3260] successful.
Nov 03 13:53:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d7568c-7296-4fc2-bfc6-3492e919608a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[716d9266-47fb-4f8f-9b3c-e23d3ab0485b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.722s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] <== disconnect_volume: return (1723ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-a491db34-ce83-45e4-93eb-ea765af90393 req-7c32f7a6-1bbb-41ef-b8e7-c1d5c50b402b service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a491db34-ce83-45e4-93eb-ea765af90393 req-7c32f7a6-1bbb-41ef-b8e7-c1d5c50b402b service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a491db34-ce83-45e4-93eb-ea765af90393 req-7c32f7a6-1bbb-41ef-b8e7-c1d5c50b402b service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a491db34-ce83-45e4-93eb-ea765af90393 req-7c32f7a6-1bbb-41ef-b8e7-c1d5c50b402b service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-a491db34-ce83-45e4-93eb-ea765af90393 req-7c32f7a6-1bbb-41ef-b8e7-c1d5c50b402b service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:01 user nova-compute[74582]: WARNING nova.compute.manager [req-a491db34-ce83-45e4-93eb-ea765af90393 req-7c32f7a6-1bbb-41ef-b8e7-c1d5c50b402b service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state active and task_state rescuing.
Nov 03 13:53:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '926114b3-1849-465b-94fb-3a1d6e49d56e', 'attached_at': '', 'detached_at': '', 'volume_id': '6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'serial'} {{(pid=74582) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] swap_volume: removing Cinder connection for volume 46d7568c-7296-4fc2-bfc6-3492e919608a {{(pid=74582) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.part /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.converted" returned: 0 in 0.556s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "6a62550edfef7c468bacef6481a709c249f287b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.335s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "6a62550edfef7c468bacef6481a709c249f287b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "6a62550edfef7c468bacef6481a709c249f287b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9,backing_fmt=raw /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9,backing_fmt=raw /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue" returned: 0 in 0.048s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "6a62550edfef7c468bacef6481a709c249f287b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'migration_context' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<da0950d0-3380-4104-8dca-023612958b01> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Start _get_guest_xml network_info=[{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "vif_mac": "fa:16:3e:56:8d:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b495ee9a-5dcd-4330-917d-22a4caeaafe1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea9cfae6-03a3-444f-af61-0efb00b78b78', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'da0950d0-3380-4104-8dca-023612958b01', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9e21104-72e8-4171-8f72-2293706ab856', 'serial': 'c9e21104-72e8-4171-8f72-2293706ab856'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'resources' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<da0950d0-3380-4104-8dca-023612958b01> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'numa_topology' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<da0950d0-3380-4104-8dca-023612958b01> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:53:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:53:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'vcpu_model' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<da0950d0-3380-4104-8dca-023612958b01> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:53:02 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:53:02 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:53:02 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] swap_volume: Updating volume 46d7568c-7296-4fc2-bfc6-3492e919608a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "djbgVeMS", "auth_password": "EHxlypdDbT0fIh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "6d4ea099-378f-4780-ba17-e4b94b8db8bc"}, "status": "reserved", "instance": "926114b3-1849-465b-94fb-3a1d6e49d56e", "attached_at": "", "detached_at": "", "volume_id": "6d4ea099-378f-4780-ba17-e4b94b8db8bc", "serial": "6d4ea099-378f-4780-ba17-e4b94b8db8bc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'no_device': None, 'attachment_id': '6d2c349a-aa28-44f2-ac4e-ef39f396f0e3'} {{(pid=74582) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44387b9-b664-4ce9-bbdf-ba1c2135d7c2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yfEkADGF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 13:53:02 user nova-compute[74582]: node.name = iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:53:02 user nova-compute[74582]: node.tpgt = -1
Nov 03 13:53:02 user nova-compute[74582]: node.startup = automatic
Nov 03 13:53:02 user nova-compute[74582]: node.leading_login = No
Nov 03 13:53:02 user nova-compute[74582]: iface.iscsi_ifacename = default
Nov 03 13:53:02 user nova-compute[74582]: iface.net_ifacename = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.ipaddress = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.prefix_len = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.hwaddress = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.transport_name = tcp
Nov 03 13:53:02 user nova-compute[74582]: iface.initiatorname = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.vlan_id = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.vlan_priority = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.vlan_state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.iface_num = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.mtu = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.port = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.bootproto = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.subnet_mask = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.gateway = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_alt_client_id = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_dns = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_learn_iqn = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_vendor_id_state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_vendor_id = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.dhcp_slp_da = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.fragmentation = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.gratuitous_arp = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.incoming_forwarding = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.tos_state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.tos = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.ttl = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.delayed_ack = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.tcp_nagle = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.tcp_wsf_state = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.tcp_wsf = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.tcp_timer_scale = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.tcp_timestamp = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.redirect = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.def_task_mgmt_timeout = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.header_digest = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.data_digest = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.immediate_data = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.initial_r2t = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.data_seq_inorder = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.data_pdu_inorder = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.erl = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.max_receive_data_len = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.first_burst_len = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.max_outstanding_r2t = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.max_burst_len = 0
Nov 03 13:53:02 user nova-compute[74582]: iface.chap_auth = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.bidi_chap = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.strict_login_compliance = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.discovery_auth = <empty>
Nov 03 13:53:02 user nova-compute[74582]: iface.discovery_logout = <empty>
Nov 03 13:53:02 user nova-compute[74582]: node.discovery_address = <empty>
Nov 03 13:53:02 user nova-compute[74582]: node.discovery_port = 0
Nov 03 13:53:02 user nova-compute[74582]: node.discovery_type = static
Nov 03 13:53:02 user nova-compute[74582]: node.session.initial_cmdsn = 0
Nov 03 13:53:02 user nova-compute[74582]: node.session.initial_login_retry_max = 8
Nov 03 13:53:02 user nova-compute[74582]: node.session.xmit_thread_priority = -20
Nov 03 13:53:02 user nova-compute[74582]: node.session.cmds_max = 128
Nov 03 13:53:02 user nova-compute[74582]: node.session.queue_depth = 32
Nov 03 13:53:02 user nova-compute[74582]: node.session.nr_sessions = 1
Nov 03 13:53:02 user nova-compute[74582]: node.session.auth.authmethod = CHAP
Nov 03 13:53:02 user nova-compute[74582]: node.session.auth.username = yfEkADGF
Nov 03 13:53:02 user nova-compute[74582]: node.session.auth.password = ***
Nov 03 13:53:02 user nova-compute[74582]: node.session.auth.username_in = <empty>
Nov 03 13:53:02 user nova-compute[74582]: node.session.auth.password_in = <empty>
Nov 03 13:53:02 user nova-compute[74582]: node.session.auth.chap_algs = MD5
Nov 03 13:53:02 user nova-compute[74582]: node.session.timeo.replacement_timeout = 120
Nov 03 13:53:02 user nova-compute[74582]: node.session.err_timeo.abort_timeout = 15
Nov 03 13:53:02 user nova-compute[74582]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 13:53:02 user nova-compute[74582]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 13:53:02 user nova-compute[74582]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.FastAbort = Yes
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.InitialR2T = No
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.ImmediateData = Yes
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.MaxConnections = 1
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 13:53:02 user nova-compute[74582]: node.session.iscsi.ERL = 0
Nov 03 13:53:02 user nova-compute[74582]: node.session.scan = manual
Nov 03 13:53:02 user nova-compute[74582]: node.session.reopen_max = 0
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].address = 172.16.0.220
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].port = 3260
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].startup = manual
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].tcp.window_size = 524288
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].tcp.type_of_service = 0
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].timeo.logout_timeout = 15
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].timeo.login_timeout = 15
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].timeo.auth_timeout = 45
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].iscsi.DataDigest = None
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].iscsi.IFMarker = No
Nov 03 13:53:02 user nova-compute[74582]: node.conn[0].iscsi.OFMarker = No
Nov 03 13:53:02 user nova-compute[74582]: # END RECORD
Nov 03 13:53:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a369485-d842-4f25-a27f-638c30a33b3d tempest-TestVolumeSwap-324680602 tempest-TestVolumeSwap-324680602-project-admin] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 86.365s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f3021b-ebab-4db2-834b-7d18b3b7c3b6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18cb6c-9131-4ab5-bbf1-d4bcf253ec58]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfEkADGF {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfEkADGF" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d86386-c1d6-43eb-a41a-744d80cae0cd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfEkADGF'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc098383-2884-461c-8283-3b23e545a967]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ec009-c2e1-4e20-a36d-35654b305c7d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:53:02 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:53:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb9514f-6396-4aba-9483-c26542ebfc87]: (4, ('0 0 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== connect_volume: return (172ms) {'type': 'block', 'scsi_wwn': '23061363131353239', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061363131353239', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-901676576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-901676576',id=13,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:51:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-rnq0c0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:51:53Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=da0950d0-3380-4104-8dca-023612958b01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "vif_mac": "fa:16:3e:56:8d:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "vif_mac": "fa:16:3e:56:8d:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'pci_devices' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.objects.base [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<da0950d0-3380-4104-8dca-023612958b01> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:53:02 user nova-compute[74582]:   <uuid>da0950d0-3380-4104-8dca-023612958b01</uuid>
Nov 03 13:53:02 user nova-compute[74582]:   <name>instance-0000000d</name>
Nov 03 13:53:02 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:53:02 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:53:02 user nova-compute[74582]:   <metadata>
Nov 03 13:53:02 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:53:02 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:53:02 user nova-compute[74582]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-901676576</nova:name>
Nov 03 13:53:02 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:53:02</nova:creationTime>
Nov 03 13:53:02 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:53:02 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:53:02 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:53:02 user nova-compute[74582]:       <nova:owner>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:user uuid="e900eb8f4f6548f183010bc08a3c66f4">tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member</nova:user>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:project uuid="7bc44a2fb46b4a649544d7e506a2d96b">tempest-ServerBootFromVolumeStableRescueTest-412298968</nova:project>
Nov 03 13:53:02 user nova-compute[74582]:       </nova:owner>
Nov 03 13:53:02 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:53:02 user nova-compute[74582]:       <nova:ports>
Nov 03 13:53:02 user nova-compute[74582]:         <nova:port uuid="1609f201-4161-4c46-95a4-f307a062ee0f">
Nov 03 13:53:02 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 13:53:02 user nova-compute[74582]:         </nova:port>
Nov 03 13:53:02 user nova-compute[74582]:       </nova:ports>
Nov 03 13:53:02 user nova-compute[74582]:     </nova:instance>
Nov 03 13:53:02 user nova-compute[74582]:   </metadata>
Nov 03 13:53:02 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:53:02 user nova-compute[74582]:     <system>
Nov 03 13:53:02 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:53:02 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:53:02 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:53:02 user nova-compute[74582]:       <entry name="serial">da0950d0-3380-4104-8dca-023612958b01</entry>
Nov 03 13:53:02 user nova-compute[74582]:       <entry name="uuid">da0950d0-3380-4104-8dca-023612958b01</entry>
Nov 03 13:53:02 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:53:02 user nova-compute[74582]:     </system>
Nov 03 13:53:02 user nova-compute[74582]:   </sysinfo>
Nov 03 13:53:02 user nova-compute[74582]:   <os>
Nov 03 13:53:02 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:53:02 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:53:02 user nova-compute[74582]:   </os>
Nov 03 13:53:02 user nova-compute[74582]:   <features>
Nov 03 13:53:02 user nova-compute[74582]:     <acpi/>
Nov 03 13:53:02 user nova-compute[74582]:     <apic/>
Nov 03 13:53:02 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:53:02 user nova-compute[74582]:   </features>
Nov 03 13:53:02 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:53:02 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:53:02 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:53:02 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:53:02 user nova-compute[74582]:   </clock>
Nov 03 13:53:02 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:53:02 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:53:02 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:53:02 user nova-compute[74582]:   </cpu>
Nov 03 13:53:02 user nova-compute[74582]:   <devices>
Nov 03 13:53:02 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 13:53:02 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:02 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 13:53:02 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:53:02 user nova-compute[74582]:       <serial>c9e21104-72e8-4171-8f72-2293706ab856</serial>
Nov 03 13:53:02 user nova-compute[74582]:     </disk>
Nov 03 13:53:02 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:53:02 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:53:02 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue"/>
Nov 03 13:53:02 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 13:53:02 user nova-compute[74582]:       <boot order="1"/>
Nov 03 13:53:02 user nova-compute[74582]:     </disk>
Nov 03 13:53:02 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:53:02 user nova-compute[74582]:       <mac address="fa:16:3e:56:8d:ac"/>
Nov 03 13:53:02 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:53:02 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:53:02 user nova-compute[74582]:       <target dev="tap1609f201-41"/>
Nov 03 13:53:02 user nova-compute[74582]:     </interface>
Nov 03 13:53:02 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:53:02 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/console.log" append="off"/>
Nov 03 13:53:02 user nova-compute[74582]:     </serial>
Nov 03 13:53:02 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:53:02 user nova-compute[74582]:     <video>
Nov 03 13:53:02 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:53:02 user nova-compute[74582]:     </video>
Nov 03 13:53:02 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:53:02 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:53:02 user nova-compute[74582]:     </rng>
Nov 03 13:53:02 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:53:02 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:53:02 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:53:02 user nova-compute[74582]:     </memballoon>
Nov 03 13:53:02 user nova-compute[74582]:   </devices>
Nov 03 13:53:02 user nova-compute[74582]: </domain>
Nov 03 13:53:02 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:53:02 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance destroyed successfully.
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:53:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No VIF found with MAC fa:16:3e:56:8d:ac, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:03 user nova-compute[74582]: INFO nova.compute.manager [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Detaching volume 6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:53:03 user nova-compute[74582]: INFO nova.virt.block_device [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Attempting to driver detach volume 6d4ea099-378f-4780-ba17-e4b94b8db8bc from mountpoint /dev/vdb
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Attempting to detach device vdb from instance 926114b3-1849-465b-94fb-3a1d6e49d56e from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:53:03 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:03 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 13:53:03 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:53:03 user nova-compute[74582]:   <serial>6d4ea099-378f-4780-ba17-e4b94b8db8bc</serial>
Nov 03 13:53:03 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:53:03 user nova-compute[74582]: </disk>
Nov 03 13:53:03 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:53:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Successfully detached device vdb from instance 926114b3-1849-465b-94fb-3a1d6e49d56e from the persistent domain config.
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 926114b3-1849-465b-94fb-3a1d6e49d56e from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:53:03 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:03 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 13:53:03 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:53:03 user nova-compute[74582]:   <serial>6d4ea099-378f-4780-ba17-e4b94b8db8bc</serial>
Nov 03 13:53:03 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:53:03 user nova-compute[74582]: </disk>
Nov 03 13:53:03 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:03 user nova-compute[74582]: INFO nova.compute.manager [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Detaching volume 12775148-ce24-4d39-82d8-798cef96bb32
Nov 03 13:53:03 user nova-compute[74582]: INFO nova.virt.block_device [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Attempting to driver detach volume 12775148-ce24-4d39-82d8-798cef96bb32 from mountpoint /dev/vdc
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Attempting to detach device vdc from instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:53:03 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:03 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:53:03 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 13:53:03 user nova-compute[74582]:   <serial>12775148-ce24-4d39-82d8-798cef96bb32</serial>
Nov 03 13:53:03 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 13:53:03 user nova-compute[74582]: </disk>
Nov 03 13:53:03 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:53:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully detached device vdc from instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 from the persistent domain config.
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:53:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:53:03 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:03 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:53:03 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 13:53:03 user nova-compute[74582]:   <serial>12775148-ce24-4d39-82d8-798cef96bb32</serial>
Nov 03 13:53:03 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 13:53:03 user nova-compute[74582]: </disk>
Nov 03 13:53:03 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-0a563653-5a18-477e-b24d-5102ae10779c req-4e9dadcd-25d7-4ad4-a1db-5c7feb5061a1 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0a563653-5a18-477e-b24d-5102ae10779c req-4e9dadcd-25d7-4ad4-a1db-5c7feb5061a1 service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0a563653-5a18-477e-b24d-5102ae10779c req-4e9dadcd-25d7-4ad4-a1db-5c7feb5061a1 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0a563653-5a18-477e-b24d-5102ae10779c req-4e9dadcd-25d7-4ad4-a1db-5c7feb5061a1 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-0a563653-5a18-477e-b24d-5102ae10779c req-4e9dadcd-25d7-4ad4-a1db-5c7feb5061a1 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:04 user nova-compute[74582]: WARNING nova.compute.manager [req-0a563653-5a18-477e-b24d-5102ae10779c req-4e9dadcd-25d7-4ad4-a1db-5c7feb5061a1 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state active and task_state rescuing.
Nov 03 13:53:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:53:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-2f84bb52-e794-40fe-9ff2-4595a6821393 req-991e0148-8e0e-4407-8fce-9b82ac678eba service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2f84bb52-e794-40fe-9ff2-4595a6821393 req-991e0148-8e0e-4407-8fce-9b82ac678eba service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2f84bb52-e794-40fe-9ff2-4595a6821393 req-991e0148-8e0e-4407-8fce-9b82ac678eba service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2f84bb52-e794-40fe-9ff2-4595a6821393 req-991e0148-8e0e-4407-8fce-9b82ac678eba service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-2f84bb52-e794-40fe-9ff2-4595a6821393 req-991e0148-8e0e-4407-8fce-9b82ac678eba service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:06 user nova-compute[74582]: WARNING nova.compute.manager [req-2f84bb52-e794-40fe-9ff2-4595a6821393 req-991e0148-8e0e-4407-8fce-9b82ac678eba service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state active and task_state rescuing.
Nov 03 13:53:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ea014361-d9ac-4464-9435-6dc0c469b4ef tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:53:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02c8e503-1dce-4a76-adc7-93b3f04985ce is timed out.
Nov 03 13:53:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully detached device vdb from instance 02c8e503-1dce-4a76-adc7-93b3f04985ce from the live domain config.
Nov 03 13:53:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYpsbBmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:53:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1323d2a2-43fc-428b-bb39-2f1be4d77ca9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:53:14 user nova-compute[74582]: No targets found.
Nov 03 13:53:14 user nova-compute[74582]: iSNS:
Nov 03 13:53:14 user nova-compute[74582]: No targets found.
Nov 03 13:53:14 user nova-compute[74582]: STATIC:
Nov 03 13:53:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:53:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32
Nov 03 13:53:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:53:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712
Nov 03 13:53:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:53:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:14 user nova-compute[74582]: FIRMWARE:
Nov 03 13:53:14 user nova-compute[74582]: No targets found.
Nov 03 13:53:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:53:14 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:53:14 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e346692a-b695-423e-ab85-33a597f2453e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[673cb4a7-dabd-442e-8807-74373064f8f0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:53:14 user nova-compute[74582]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 (non-flash)
Nov 03 13:53:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682b0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b02f09-1329-43ce-89de-9fab5f592cbb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c90251-f964-44ed-a270-693799aecde7]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c12f5-fe10-4a6c-b796-3c8eac132a7f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b347fa-5481-4146-a8ff-807639548c45]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e11cfa2-5973-4a2d-9358-6773d7dd393c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[98266cb7-bd40-4f34-a7ab-733bc04e34b1]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260]
Nov 03 13:53:14 user nova-compute[74582]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712, portal: 172.16.0.220,3260] successful.
Nov 03 13:53:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a157de-3dd0-4dcb-8a42-f49d19ec2712 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec796ca-78e5-45f3-afa9-c8bafb95bc9b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== disconnect_volume: return (379ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:53:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:53:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d63b42ab-9fe0-4bed-8165-25892efdef8d tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.833s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:22 user nova-compute[74582]: INFO nova.compute.manager [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Terminating instance
Nov 03 13:53:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-c3aae2b1-7518-4542-9416-326d6ddc9cb7 req-0837986a-20ff-473e-a49f-463f36b45c19 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-vif-unplugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c3aae2b1-7518-4542-9416-326d6ddc9cb7 req-0837986a-20ff-473e-a49f-463f36b45c19 service nova] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c3aae2b1-7518-4542-9416-326d6ddc9cb7 req-0837986a-20ff-473e-a49f-463f36b45c19 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c3aae2b1-7518-4542-9416-326d6ddc9cb7 req-0837986a-20ff-473e-a49f-463f36b45c19 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-c3aae2b1-7518-4542-9416-326d6ddc9cb7 req-0837986a-20ff-473e-a49f-463f36b45c19 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] No waiting events found dispatching network-vif-unplugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-c3aae2b1-7518-4542-9416-326d6ddc9cb7 req-0837986a-20ff-473e-a49f-463f36b45c19 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-vif-unplugged-e6216837-04f4-48e0-9250-d59145aaea3c for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Instance destroyed successfully.
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'resources' on Instance uuid a8ade565-978b-4c2a-b205-99be6dba39cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-21475602',display_name='tempest-VolumesAdminNegativeTest-server-21475602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-21475602',id=14,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:51:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9789163764134874a379056ee7cf142b',ramdisk_id='',reservation_id='r-uop1j8ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-403557302',owner_user_name='tempest-VolumesAdminNegativeTest-403557302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:51:21Z,user_data=None,user_id='d5d8a8463e6b44b5a49ada2835baf0d5',uuid=a8ade565-978b-4c2a-b205-99be6dba39cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converting VIF {"id": "e6216837-04f4-48e0-9250-d59145aaea3c", "address": "fa:16:3e:53:b1:ea", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6216837-04", "ovs_interfaceid": "e6216837-04f4-48e0-9250-d59145aaea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG os_vif [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6216837-04, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebeb86e5-507c-46ca-9344-e69311373a95) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:23 user nova-compute[74582]: INFO os_vif [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6216837-04f4-48e0-9250-d59145aaea3c,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6216837-04')
Nov 03 13:53:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Deleting instance files /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd_del
Nov 03 13:53:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Deletion of /opt/stack/data/nova/instances/a8ade565-978b-4c2a-b205-99be6dba39cd_del complete
Nov 03 13:53:23 user nova-compute[74582]: INFO nova.compute.manager [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 03 13:53:23 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:53:23 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Took 0.45 seconds to deallocate network for instance.
Nov 03 13:53:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-24595555-a8e6-4fbb-b4b9-0478cbf02d89 req-4c396d05-0ef0-4ccf-b20e-531123201745 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-vif-deleted-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:53:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 926114b3-1849-465b-94fb-3a1d6e49d56e is timed out.
Nov 03 13:53:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Successfully detached device vdb from instance 926114b3-1849-465b-94fb-3a1d6e49d56e from the live domain config.
Nov 03 13:53:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'djbgVeMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '6d4ea099-378f-4780-ba17-e4b94b8db8bc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:53:24 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Deleted allocations for instance a8ade565-978b-4c2a-b205-99be6dba39cd
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaeb9f4-f38c-4c6e-a855-c8e109c99e79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:53:24 user nova-compute[74582]: No targets found.
Nov 03 13:53:24 user nova-compute[74582]: iSNS:
Nov 03 13:53:24 user nova-compute[74582]: No targets found.
Nov 03 13:53:24 user nova-compute[74582]: STATIC:
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: FIRMWARE:
Nov 03 13:53:24 user nova-compute[74582]: No targets found.
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:53:24 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:53:24 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d2790-4994-4371-b1c0-6a5c72823b4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58d63e-0668-40c6-b540-2aae24d6a743]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc (non-flash)
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68406950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc'): ({'sdg'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Removing single pathed devices sdg {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-52746a67-f9d6-44b8-a362-b1f215aa6025 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda654a5-e180-4908-a134-b0ac1ecdb2ca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a818a89-a086-4f49-9299-00b7928ca232]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Flushing IO for device /dev/sdg {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c57abd-4c38-4213-988b-05385bfff986]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5ec0e-bc53-4b21-b682-290d608fecc0]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e75539-78cf-49c9-a491-5d987ebe5258]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79e2b2-0a25-4975-b6d6-578de49c333b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260]
Nov 03 13:53:24 user nova-compute[74582]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc, portal: 172.16.0.220,3260] successful.
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4ea099-378f-4780-ba17-e4b94b8db8bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a1cc9-7dc4-4ea0-88ba-b7bd4f35cfe1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] <== disconnect_volume: return (344ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:53:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 is timed out.
Nov 03 13:53:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully detached device vdc from instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 from the live domain config.
Nov 03 13:53:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCnqkJgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:53:24 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af97e7-eab3-47b0-9491-040fd7900f0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:53:24 user nova-compute[74582]: No targets found.
Nov 03 13:53:24 user nova-compute[74582]: iSNS:
Nov 03 13:53:24 user nova-compute[74582]: No targets found.
Nov 03 13:53:24 user nova-compute[74582]: STATIC:
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:53:24 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:53:24 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:53:24 user nova-compute[74582]: FIRMWARE:
Nov 03 13:53:24 user nova-compute[74582]: No targets found.
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:53:24 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:53:24 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f2b77-70ff-4aff-ad32-4a59fddb1cc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b24d0-67c9-40d4-aff9-f985d3934879]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68404670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32'): ({'sdf'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Removing single pathed devices sdf {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1774a5-e1eb-4de0-a4a1-9e099715501c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[636be406-d946-4537-8737-674182a1790a]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flushing IO for device /dev/sdf {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[18962b74-8251-48b2-a914-198a94857823]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda08dc-20df-4faf-853b-43fb338bbd4a]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ac2ac-f00b-448d-a441-1dff0d0d0dd4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbbc5d7-318c-4659-8637-ff9c98b5dde9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260]
Nov 03 13:53:24 user nova-compute[74582]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32, portal: 172.16.0.220,3260] successful.
Nov 03 13:53:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12775148-ce24-4d39-82d8-798cef96bb32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a91a01-8d07-4ee0-a9ee-e3457a8e9557]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] <== disconnect_volume: return (330ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-9a8214fe-7867-4b70-af58-c8001c7dd590 req-049758fe-75cc-4333-9817-beb1df7a0806 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received event network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9a8214fe-7867-4b70-af58-c8001c7dd590 req-049758fe-75cc-4333-9817-beb1df7a0806 service nova] Acquiring lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9a8214fe-7867-4b70-af58-c8001c7dd590 req-049758fe-75cc-4333-9817-beb1df7a0806 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9a8214fe-7867-4b70-af58-c8001c7dd590 req-049758fe-75cc-4333-9817-beb1df7a0806 service nova] Lock "a8ade565-978b-4c2a-b205-99be6dba39cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-9a8214fe-7867-4b70-af58-c8001c7dd590 req-049758fe-75cc-4333-9817-beb1df7a0806 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] No waiting events found dispatching network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:24 user nova-compute[74582]: WARNING nova.compute.manager [req-9a8214fe-7867-4b70-af58-c8001c7dd590 req-049758fe-75cc-4333-9817-beb1df7a0806 service nova] [instance: a8ade565-978b-4c2a-b205-99be6dba39cd] Received unexpected event network-vif-plugged-e6216837-04f4-48e0-9250-d59145aaea3c for instance with vm_state deleted and task_state None.
Nov 03 13:53:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lazy-loading 'flavor' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-74d0eb90-3d86-402a-9c3d-19c4843d6dee tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.402s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'flavor' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f64e6587-d544-490e-88b7-8a987e39b645 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.394s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:27 user nova-compute[74582]: WARNING nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 59ca7381-f253-4009-8c29-f43ed1b335a3 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 01985e3c-5b20-4701-99c7-d374f5a2d76d {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "da0950d0-3380-4104-8dca-023612958b01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: INFO nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "da0950d0-3380-4104-8dca-023612958b01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:27 user nova-compute[74582]: WARNING nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance is unexpectedly not found. Ignore.
Nov 03 13:53:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.202s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:43 user nova-compute[74582]: INFO nova.compute.manager [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Terminating instance
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe0bfd3c-fcf3-4f24-8a8b-9b55c68b8bde req-3c68d6f1-6eec-4c00-970f-4afd5786ee1c service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-vif-unplugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe0bfd3c-fcf3-4f24-8a8b-9b55c68b8bde req-3c68d6f1-6eec-4c00-970f-4afd5786ee1c service nova] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe0bfd3c-fcf3-4f24-8a8b-9b55c68b8bde req-3c68d6f1-6eec-4c00-970f-4afd5786ee1c service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe0bfd3c-fcf3-4f24-8a8b-9b55c68b8bde req-3c68d6f1-6eec-4c00-970f-4afd5786ee1c service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe0bfd3c-fcf3-4f24-8a8b-9b55c68b8bde req-3c68d6f1-6eec-4c00-970f-4afd5786ee1c service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] No waiting events found dispatching network-vif-unplugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe0bfd3c-fcf3-4f24-8a8b-9b55c68b8bde req-3c68d6f1-6eec-4c00-970f-4afd5786ee1c service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-vif-unplugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Instance destroyed successfully.
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'resources' on Instance uuid 02c8e503-1dce-4a76-adc7-93b3f04985ce {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1365815229',display_name='tempest-AttachVolumeNegativeTest-server-1365815229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1365815229',id=5,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM0o/vV+mc8unwgXFZLFpYqmN7AGoa09tNlMbnx5NgxmS56gcNdpPq0wuwYBJ1myKFOGA7EPjCHf6W2fJx5fbsDqGUO2jqZrVXRxYQNEwQBPIHwAL9Od0ga2e6K0ndGgA==',key_name='tempest-keypair-155164618',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-v1i08eri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=02c8e503-1dce-4a76-adc7-93b3f04985ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "address": "fa:16:3e:f7:59:3e", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71933a3-2c", "ovs_interfaceid": "c71933a3-2c2b-4986-9d51-f3f1c8978bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG os_vif [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc71933a3-2c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1453ddfc-4b6b-42d1-ba27-0980770e73c9) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:43 user nova-compute[74582]: INFO os_vif [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:59:3e,bridge_name='br-int',has_traffic_filtering=True,id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71933a3-2c')
Nov 03 13:53:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Deleting instance files /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce_del
Nov 03 13:53:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Deletion of /opt/stack/data/nova/instances/02c8e503-1dce-4a76-adc7-93b3f04985ce_del complete
Nov 03 13:53:44 user nova-compute[74582]: INFO nova.compute.manager [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 03 13:53:44 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:53:44 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:53:44 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:53:44 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:53:44 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Took 0.70 seconds to deallocate network for instance.
Nov 03 13:53:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-590450bd-2afa-419a-97db-8a9227ceccfc req-0208e773-afc1-4ddf-9760-cf43a5810cf4 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-vif-deleted-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:44 user nova-compute[74582]: INFO nova.compute.manager [req-590450bd-2afa-419a-97db-8a9227ceccfc req-0208e773-afc1-4ddf-9760-cf43a5810cf4 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Neutron deleted interface c71933a3-2c2b-4986-9d51-f3f1c8978bc5; detaching it from the instance and deleting it from the info cache
Nov 03 13:53:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-590450bd-2afa-419a-97db-8a9227ceccfc req-0208e773-afc1-4ddf-9760-cf43a5810cf4 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:53:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-590450bd-2afa-419a-97db-8a9227ceccfc req-0208e773-afc1-4ddf-9760-cf43a5810cf4 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Detach interface failed, port_id=c71933a3-2c2b-4986-9d51-f3f1c8978bc5, reason: Instance 02c8e503-1dce-4a76-adc7-93b3f04985ce could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 13:53:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:45 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Deleted allocations for instance 02c8e503-1dce-4a76-adc7-93b3f04985ce
Nov 03 13:53:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4360cb0a-a8e2-447d-a6af-3360370ccb0c tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-183fce89-6e7f-4a87-a458-226d967e75fc req-70d5dec2-2a21-4673-8aa1-c8e735a8ac24 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received event network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-183fce89-6e7f-4a87-a458-226d967e75fc req-70d5dec2-2a21-4673-8aa1-c8e735a8ac24 service nova] Acquiring lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-183fce89-6e7f-4a87-a458-226d967e75fc req-70d5dec2-2a21-4673-8aa1-c8e735a8ac24 service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-183fce89-6e7f-4a87-a458-226d967e75fc req-70d5dec2-2a21-4673-8aa1-c8e735a8ac24 service nova] Lock "02c8e503-1dce-4a76-adc7-93b3f04985ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-183fce89-6e7f-4a87-a458-226d967e75fc req-70d5dec2-2a21-4673-8aa1-c8e735a8ac24 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] No waiting events found dispatching network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:45 user nova-compute[74582]: WARNING nova.compute.manager [req-183fce89-6e7f-4a87-a458-226d967e75fc req-70d5dec2-2a21-4673-8aa1-c8e735a8ac24 service nova] [instance: 02c8e503-1dce-4a76-adc7-93b3f04985ce] Received unexpected event network-vif-plugged-c71933a3-2c2b-4986-9d51-f3f1c8978bc5 for instance with vm_state deleted and task_state None.
Nov 03 13:53:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:48 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:48 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:53:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:49 user nova-compute[74582]: INFO nova.compute.manager [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Detaching volume 7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:53:49 user nova-compute[74582]: INFO nova.virt.block_device [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Attempting to driver detach volume 7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 from mountpoint /dev/vdb
Nov 03 13:53:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Attempting to detach device vdb from instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:53:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:53:49 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:49 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:53:49 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:53:49 user nova-compute[74582]:   <serial>7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9</serial>
Nov 03 13:53:49 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 13:53:49 user nova-compute[74582]: </disk>
Nov 03 13:53:49 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:53:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully detached device vdb from instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 from the persistent domain config.
Nov 03 13:53:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:53:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:53:49 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:53:49 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:53:49 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:53:49 user nova-compute[74582]:   <serial>7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9</serial>
Nov 03 13:53:49 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 13:53:49 user nova-compute[74582]: </disk>
Nov 03 13:53:49 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:53:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updating instance_info_cache with network_info: [{"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-59ca7381-f253-4009-8c29-f43ed1b335a3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:53:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:53 user nova-compute[74582]: INFO nova.compute.manager [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Terminating instance
Nov 03 13:53:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:53 user nova-compute[74582]: INFO nova.compute.manager [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Terminating instance
Nov 03 13:53:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-3fe5523d-3d98-414c-8da9-4c8cf0360439 req-57abb6a7-46f0-46c1-9980-1485ec2f8926 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-unplugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3fe5523d-3d98-414c-8da9-4c8cf0360439 req-57abb6a7-46f0-46c1-9980-1485ec2f8926 service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3fe5523d-3d98-414c-8da9-4c8cf0360439 req-57abb6a7-46f0-46c1-9980-1485ec2f8926 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3fe5523d-3d98-414c-8da9-4c8cf0360439 req-57abb6a7-46f0-46c1-9980-1485ec2f8926 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-3fe5523d-3d98-414c-8da9-4c8cf0360439 req-57abb6a7-46f0-46c1-9980-1485ec2f8926 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-unplugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-3fe5523d-3d98-414c-8da9-4c8cf0360439 req-57abb6a7-46f0-46c1-9980-1485ec2f8926 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-unplugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-c6c6234c-71fe-45b2-9b05-3f6b64b71b99 req-9d09a20f-a61b-4fdd-8358-c6c8baf3151b service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-vif-unplugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c6c6234c-71fe-45b2-9b05-3f6b64b71b99 req-9d09a20f-a61b-4fdd-8358-c6c8baf3151b service nova] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c6c6234c-71fe-45b2-9b05-3f6b64b71b99 req-9d09a20f-a61b-4fdd-8358-c6c8baf3151b service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c6c6234c-71fe-45b2-9b05-3f6b64b71b99 req-9d09a20f-a61b-4fdd-8358-c6c8baf3151b service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-c6c6234c-71fe-45b2-9b05-3f6b64b71b99 req-9d09a20f-a61b-4fdd-8358-c6c8baf3151b service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] No waiting events found dispatching network-vif-unplugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-c6c6234c-71fe-45b2-9b05-3f6b64b71b99 req-9d09a20f-a61b-4fdd-8358-c6c8baf3151b service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-vif-unplugged-c64e3520-647a-4708-8765-bad6362ee795 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:53:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:53:54 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Instance destroyed successfully.
Nov 03 13:53:54 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lazy-loading 'resources' on Instance uuid 926114b3-1849-465b-94fb-3a1d6e49d56e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1858662947',display_name='tempest-TestVolumeSwap-server-1858662947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1858662947',id=9,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbS8Iq4oUyc0pw4rJxwDhlnU7/tD7moS83x7fS/WLocowPrk3HS86CmaELLuWDonXP0ql71IjmozEujQUf4tUSCqjH+Pys84uDXCJsHR2aduQQ7f1RgVEVoGeYVpzne2A==',key_name='tempest-keypair-1658946133',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1371a42181fb4e61981eaf7680123707',ramdisk_id='',reservation_id='r-1a6cyjux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-230062966',owner_user_name='tempest-TestVolumeSwap-230062966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c51087d6b89d42e9890fcc9d4232e901',uuid=926114b3-1849-465b-94fb-3a1d6e49d56e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Converting VIF {"id": "c64e3520-647a-4708-8765-bad6362ee795", "address": "fa:16:3e:bd:42:13", "network": {"id": "c0dbd626-0617-4c82-89b5-d59410b3b9d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1716418458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1371a42181fb4e61981eaf7680123707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64e3520-64", "ovs_interfaceid": "c64e3520-647a-4708-8765-bad6362ee795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG os_vif [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc64e3520-64, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:55 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:53:55 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=25.44240951538086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1062de02-54cb-471e-84f3-5dadfe9fcfd9) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Instance destroyed successfully.
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'resources' on Instance uuid e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: INFO os_vif [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:42:13,bridge_name='br-int',has_traffic_filtering=True,id=c64e3520-647a-4708-8765-bad6362ee795,network=Network(c0dbd626-0617-4c82-89b5-d59410b3b9d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64e3520-64')
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Deleting instance files /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e_del
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Deletion of /opt/stack/data/nova/instances/926114b3-1849-465b-94fb-3a1d6e49d56e_del complete
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-181316597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-181316597',id=4,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnB/utDpecLLpWTUtILHBV1NT6pvDqpn6zX57hWvTkoWDFBCkRrcegZ5fujd6+b+W18bsggPi4c5/PT7Uit2jBo0X0tGzu8GzEJ+mCoiR4yaoe2rXdTIb7RW+HfQQbKGQ==',key_name='tempest-keypair-810171847',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-i93tzi7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=e6a282d9-0ea3-431e-8df4-ffe5d8ae6823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "address": "fa:16:3e:25:01:5f", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc85b5b-09", "ovs_interfaceid": "7dc85b5b-09fc-488a-814e-40dc04da5ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG os_vif [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dc85b5b-09, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16e8eaac-c5b8-46f0-afec-65df0b08f593) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:53:55 user nova-compute[74582]: INFO os_vif [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:01:5f,bridge_name='br-int',has_traffic_filtering=True,id=7dc85b5b-09fc-488a-814e-40dc04da5ec2,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc85b5b-09')
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Deleting instance files /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823_del
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Deletion of /opt/stack/data/nova/instances/e6a282d9-0ea3-431e-8df4-ffe5d8ae6823_del complete
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.compute.manager [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Took 1.72 seconds to destroy the instance on the hypervisor.
Nov 03 13:53:55 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 926114b3-1849-465b-94fb-3a1d6e49d56e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:53:55 user nova-compute[74582]: INFO nova.compute.manager [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 03 13:53:55 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:53:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-7205e5e5-4cc9-4864-a5b6-06502596978b req-d7588c7a-80e6-472c-b926-60cce9829625 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7205e5e5-4cc9-4864-a5b6-06502596978b req-d7588c7a-80e6-472c-b926-60cce9829625 service nova] Acquiring lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7205e5e5-4cc9-4864-a5b6-06502596978b req-d7588c7a-80e6-472c-b926-60cce9829625 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7205e5e5-4cc9-4864-a5b6-06502596978b req-d7588c7a-80e6-472c-b926-60cce9829625 service nova] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-7205e5e5-4cc9-4864-a5b6-06502596978b req-d7588c7a-80e6-472c-b926-60cce9829625 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] No waiting events found dispatching network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:56 user nova-compute[74582]: WARNING nova.compute.manager [req-7205e5e5-4cc9-4864-a5b6-06502596978b req-d7588c7a-80e6-472c-b926-60cce9829625 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received unexpected event network-vif-plugged-7dc85b5b-09fc-488a-814e-40dc04da5ec2 for instance with vm_state active and task_state deleting.
Nov 03 13:53:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-303dc942-27c0-46f1-90d7-07e43b504600 req-704723ac-61e8-4d42-9938-1b28af12da2d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-303dc942-27c0-46f1-90d7-07e43b504600 req-704723ac-61e8-4d42-9938-1b28af12da2d service nova] Acquiring lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-303dc942-27c0-46f1-90d7-07e43b504600 req-704723ac-61e8-4d42-9938-1b28af12da2d service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-303dc942-27c0-46f1-90d7-07e43b504600 req-704723ac-61e8-4d42-9938-1b28af12da2d service nova] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-303dc942-27c0-46f1-90d7-07e43b504600 req-704723ac-61e8-4d42-9938-1b28af12da2d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] No waiting events found dispatching network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:53:56 user nova-compute[74582]: WARNING nova.compute.manager [req-303dc942-27c0-46f1-90d7-07e43b504600 req-704723ac-61e8-4d42-9938-1b28af12da2d service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received unexpected event network-vif-plugged-c64e3520-647a-4708-8765-bad6362ee795 for instance with vm_state active and task_state deleting.
Nov 03 13:53:56 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:53:56 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Took 1.10 seconds to deallocate network for instance.
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:57 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Deleted allocations for instance e6a282d9-0ea3-431e-8df4-ffe5d8ae6823
Nov 03 13:53:57 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:53:57 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Took 1.78 seconds to deallocate network for instance.
Nov 03 13:53:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-a2cca5f4-af24-4c65-99dc-20c1714eec22 req-a2053bdd-10d5-4ee9-ba50-1ff721a9efef service nova] [instance: 926114b3-1849-465b-94fb-3a1d6e49d56e] Received event network-vif-deleted-c64e3520-647a-4708-8765-bad6362ee795 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7ad8af60-de29-4aca-9c23-92985348d0ed tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "e6a282d9-0ea3-431e-8df4-ffe5d8ae6823" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.438s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:53:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:57 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Deleted allocations for instance 926114b3-1849-465b-94fb-3a1d6e49d56e
Nov 03 13:53:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e6cce568-2234-4a8e-9c93-236d572e8bdf tempest-TestVolumeSwap-230062966 tempest-TestVolumeSwap-230062966-project-member] Lock "926114b3-1849-465b-94fb-3a1d6e49d56e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.089s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:53:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-965926ab-975e-46d6-95d2-1d059fb360ab req-0bfc6b6b-b039-440a-8252-c90ea9b7a213 service nova] [instance: e6a282d9-0ea3-431e-8df4-ffe5d8ae6823] Received event network-vif-deleted-7dc85b5b-09fc-488a-814e-40dc04da5ec2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-changed-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:53:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Refreshing instance network info cache due to event network-changed-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:53:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:53:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:53:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Refreshing network info cache for port 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:54:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated VIF entry in instance network info cache for port 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:54:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-be49f29b-2451-49aa-a210-b4fd35e6f8c0 req-1c7a2798-b298-492a-99df-2dc89ded3d98 service nova] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 is timed out.
Nov 03 13:54:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully detached device vdb from instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 from the live domain config.
Nov 03 13:54:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdckBawx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:54:09 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:54:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b4b27-a756-4d02-9f3b-7b4c083645f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:54:09 user nova-compute[74582]: No targets found.
Nov 03 13:54:09 user nova-compute[74582]: iSNS:
Nov 03 13:54:09 user nova-compute[74582]: No targets found.
Nov 03 13:54:09 user nova-compute[74582]: STATIC:
Nov 03 13:54:09 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9
Nov 03 13:54:09 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:54:09 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:54:09 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:54:09 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:54:09 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:54:09 user nova-compute[74582]: FIRMWARE:
Nov 03 13:54:09 user nova-compute[74582]: No targets found.
Nov 03 13:54:09 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:54:09 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:54:09 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f785bb97-ff9e-43fe-bd2f-a37c76c91f91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8b6cd-d1ad-41a8-b037-d5232075fcde]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:54:10 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:54:10 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:54:10 user nova-compute[74582]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 (non-flash)
Nov 03 13:54:10 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682de5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b948a4-aa98-46d6-b0f7-f7b31ba07def]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee3dbef-ffd1-450c-8cfd-8a2c7f4ed1a5]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57e2cd-94b4-4411-92a6-686a7949fcb1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b2771e-07fa-48d1-958e-50b199af1a6e]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[196aee2c-c4ce-446e-bede-cd01964bf769]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6043b1-36dc-46c8-8c13-1e4ddb77530f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260]
Nov 03 13:54:10 user nova-compute[74582]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9, portal: 172.16.0.220,3260] successful.
Nov 03 13:54:10 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8a5cd1-e453-416b-b4cf-e2a7b9b35ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd46f9-cb57-4a7f-b097-65e34576567a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== disconnect_volume: return (331ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG nova.objects.instance [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-993787f7-2d88-4cdc-b54f-7f0a6c8b4243 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:11 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:54:11 user nova-compute[74582]: INFO nova.compute.claims [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Claim successful on node user
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74582) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:54:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.policy [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec6f24a8eb554a7593b8771a4616a259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89efd26950cb4876aca4dab449f19ecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:54:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Creating image(s)
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "/opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "/opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "/opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-3fed73be-c9cc-4c8f-b8cf-fe47f90a1159 req-f0202f6d-4e99-4fce-9cc6-2c2af672c0c8 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3fed73be-c9cc-4c8f-b8cf-fe47f90a1159 req-f0202f6d-4e99-4fce-9cc6-2c2af672c0c8 service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3fed73be-c9cc-4c8f-b8cf-fe47f90a1159 req-f0202f6d-4e99-4fce-9cc6-2c2af672c0c8 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3fed73be-c9cc-4c8f-b8cf-fe47f90a1159 req-f0202f6d-4e99-4fce-9cc6-2c2af672c0c8 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-3fed73be-c9cc-4c8f-b8cf-fe47f90a1159 req-f0202f6d-4e99-4fce-9cc6-2c2af672c0c8 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:12 user nova-compute[74582]: WARNING nova.compute.manager [req-3fed73be-c9cc-4c8f-b8cf-fe47f90a1159 req-f0202f6d-4e99-4fce-9cc6-2c2af672c0c8 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state active and task_state powering-off.
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.224s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk 1073741824" returned: 0 in 0.098s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance destroyed successfully.
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f26c7269-35ab-4fc6-a1ff-4c7a7bc26eb5 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.931s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Successfully created port: 13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Cannot resize image /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Ensure instance console log exists: /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Successfully updated port: 13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquired lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-changed-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Refreshing instance network info cache due to event network-changed-13ebd409-8962-428d-9ae8-57dd2613ffc5. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] Acquiring lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:13 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating instance_info_cache with network_info: [{"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Releasing lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Instance network_info: |[{"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] Acquired lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.neutron [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Refreshing network info cache for port 13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Start _get_guest_xml network_info=[{"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:54:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-925816892',display_name='tempest-SnapshotDataIntegrityTests-server-925816892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-925816892',id=16,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1ut87jn4Pfhsc7A0fp6qP5N9bf9EaPnYBXA+8CwSiyeLZWLOudLKTOT/s5IhWHwg1OomlY1T4HosDdqo0sNtsJiSHoigtivFqLJgQ5cie3awZorZwpSBpzYPhRv10qDQ==',key_name='tempest-keypair-1143797370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89efd26950cb4876aca4dab449f19ecb',ramdisk_id='',reservation_id='r-mpc0lvvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1375647291',owner_user_name='tempest-SnapshotDataIntegrityTests-1375647291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec6f24a8eb554a7593b8771a4616a259',uuid=c73f6ba0-db7e-484e-980b-93642ef29001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Converting VIF {"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'pci_devices' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:54:14 user nova-compute[74582]:   <uuid>c73f6ba0-db7e-484e-980b-93642ef29001</uuid>
Nov 03 13:54:14 user nova-compute[74582]:   <name>instance-00000010</name>
Nov 03 13:54:14 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:54:14 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:54:14 user nova-compute[74582]:   <metadata>
Nov 03 13:54:14 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:54:14 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:54:14 user nova-compute[74582]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-925816892</nova:name>
Nov 03 13:54:14 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:54:14</nova:creationTime>
Nov 03 13:54:14 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:54:14 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:54:14 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:54:14 user nova-compute[74582]:       <nova:owner>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:user uuid="ec6f24a8eb554a7593b8771a4616a259">tempest-SnapshotDataIntegrityTests-1375647291-project-member</nova:user>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:project uuid="89efd26950cb4876aca4dab449f19ecb">tempest-SnapshotDataIntegrityTests-1375647291</nova:project>
Nov 03 13:54:14 user nova-compute[74582]:       </nova:owner>
Nov 03 13:54:14 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:54:14 user nova-compute[74582]:       <nova:ports>
Nov 03 13:54:14 user nova-compute[74582]:         <nova:port uuid="13ebd409-8962-428d-9ae8-57dd2613ffc5">
Nov 03 13:54:14 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 13:54:14 user nova-compute[74582]:         </nova:port>
Nov 03 13:54:14 user nova-compute[74582]:       </nova:ports>
Nov 03 13:54:14 user nova-compute[74582]:     </nova:instance>
Nov 03 13:54:14 user nova-compute[74582]:   </metadata>
Nov 03 13:54:14 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:54:14 user nova-compute[74582]:     <system>
Nov 03 13:54:14 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:54:14 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:54:14 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:54:14 user nova-compute[74582]:       <entry name="serial">c73f6ba0-db7e-484e-980b-93642ef29001</entry>
Nov 03 13:54:14 user nova-compute[74582]:       <entry name="uuid">c73f6ba0-db7e-484e-980b-93642ef29001</entry>
Nov 03 13:54:14 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:54:14 user nova-compute[74582]:     </system>
Nov 03 13:54:14 user nova-compute[74582]:   </sysinfo>
Nov 03 13:54:14 user nova-compute[74582]:   <os>
Nov 03 13:54:14 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:54:14 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:54:14 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:54:14 user nova-compute[74582]:   </os>
Nov 03 13:54:14 user nova-compute[74582]:   <features>
Nov 03 13:54:14 user nova-compute[74582]:     <acpi/>
Nov 03 13:54:14 user nova-compute[74582]:     <apic/>
Nov 03 13:54:14 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:54:14 user nova-compute[74582]:   </features>
Nov 03 13:54:14 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:54:14 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:54:14 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:54:14 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:54:14 user nova-compute[74582]:   </clock>
Nov 03 13:54:14 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:54:14 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:54:14 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:54:14 user nova-compute[74582]:   </cpu>
Nov 03 13:54:14 user nova-compute[74582]:   <devices>
Nov 03 13:54:14 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:54:14 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:54:14 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk"/>
Nov 03 13:54:14 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:54:14 user nova-compute[74582]:     </disk>
Nov 03 13:54:14 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:54:14 user nova-compute[74582]:       <mac address="fa:16:3e:40:c0:b6"/>
Nov 03 13:54:14 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:54:14 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:54:14 user nova-compute[74582]:       <target dev="tap13ebd409-89"/>
Nov 03 13:54:14 user nova-compute[74582]:     </interface>
Nov 03 13:54:14 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:54:14 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/console.log" append="off"/>
Nov 03 13:54:14 user nova-compute[74582]:     </serial>
Nov 03 13:54:14 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:54:14 user nova-compute[74582]:     <video>
Nov 03 13:54:14 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:54:14 user nova-compute[74582]:     </video>
Nov 03 13:54:14 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:54:14 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:54:14 user nova-compute[74582]:     </rng>
Nov 03 13:54:14 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:54:14 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:54:14 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:54:14 user nova-compute[74582]:     </memballoon>
Nov 03 13:54:14 user nova-compute[74582]:   </devices>
Nov 03 13:54:14 user nova-compute[74582]: </domain>
Nov 03 13:54:14 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-925816892',display_name='tempest-SnapshotDataIntegrityTests-server-925816892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-925816892',id=16,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1ut87jn4Pfhsc7A0fp6qP5N9bf9EaPnYBXA+8CwSiyeLZWLOudLKTOT/s5IhWHwg1OomlY1T4HosDdqo0sNtsJiSHoigtivFqLJgQ5cie3awZorZwpSBpzYPhRv10qDQ==',key_name='tempest-keypair-1143797370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89efd26950cb4876aca4dab449f19ecb',ramdisk_id='',reservation_id='r-mpc0lvvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1375647291',owner_user_name='tempest-SnapshotDataIntegrityTests-1375647291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec6f24a8eb554a7593b8771a4616a259',uuid=c73f6ba0-db7e-484e-980b-93642ef29001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Converting VIF {"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG os_vif [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e8966a9-76e7-5404-9b24-2104b7cc7e8d', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13ebd409-89, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13ebd409-89, col_values=(('qos', UUID('58195c45-e7b6-4d4d-b02e-b6593b3ac58c')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13ebd409-89, col_values=(('external_ids', {'iface-id': '13ebd409-8962-428d-9ae8-57dd2613ffc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:c0:b6', 'vm-uuid': 'c73f6ba0-db7e-484e-980b-93642ef29001'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:14 user nova-compute[74582]: INFO os_vif [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89')
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No VIF found with MAC fa:16:3e:40:c0:b6, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.neutron [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updated VIF entry in instance network info cache for port 13ebd409-8962-428d-9ae8-57dd2613ffc5. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.network.neutron [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating instance_info_cache with network_info: [{"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-1efef761-8fc3-4f7a-b2c3-1e1c6720d3c1 req-1b933559-ffbf-4009-80e2-25ebd7c583b2 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1efef761-8fc3-4f7a-b2c3-1e1c6720d3c1 req-1b933559-ffbf-4009-80e2-25ebd7c583b2 service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1efef761-8fc3-4f7a-b2c3-1e1c6720d3c1 req-1b933559-ffbf-4009-80e2-25ebd7c583b2 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1efef761-8fc3-4f7a-b2c3-1e1c6720d3c1 req-1b933559-ffbf-4009-80e2-25ebd7c583b2 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-1efef761-8fc3-4f7a-b2c3-1e1c6720d3c1 req-1b933559-ffbf-4009-80e2-25ebd7c583b2 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:14 user nova-compute[74582]: WARNING nova.compute.manager [req-1efef761-8fc3-4f7a-b2c3-1e1c6720d3c1 req-1b933559-ffbf-4009-80e2-25ebd7c583b2 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state stopped and task_state None.
Nov 03 13:54:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2cdbefde-a609-4f3f-a02e-592c988e7d00 req-dbe6f1ff-7c78-41e2-9f42-4702effdc282 service nova] Releasing lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebb2b9ac-5561-4e43-95ed-07448a60eb5f req-0da5953e-c597-4c80-812e-ae1c50b3fa4d service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebb2b9ac-5561-4e43-95ed-07448a60eb5f req-0da5953e-c597-4c80-812e-ae1c50b3fa4d service nova] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebb2b9ac-5561-4e43-95ed-07448a60eb5f req-0da5953e-c597-4c80-812e-ae1c50b3fa4d service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebb2b9ac-5561-4e43-95ed-07448a60eb5f req-0da5953e-c597-4c80-812e-ae1c50b3fa4d service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebb2b9ac-5561-4e43-95ed-07448a60eb5f req-0da5953e-c597-4c80-812e-ae1c50b3fa4d service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] No waiting events found dispatching network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:16 user nova-compute[74582]: WARNING nova.compute.manager [req-ebb2b9ac-5561-4e43-95ed-07448a60eb5f req-0da5953e-c597-4c80-812e-ae1c50b3fa4d service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received unexpected event network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 for instance with vm_state building and task_state spawning.
Nov 03 13:54:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:54:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Instance spawned successfully.
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:18 user nova-compute[74582]: INFO nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-e5c170b3-1c26-4874-8199-ad264b18cc6e req-f7a40e29-82b2-4b29-88db-0934785aa616 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e5c170b3-1c26-4874-8199-ad264b18cc6e req-f7a40e29-82b2-4b29-88db-0934785aa616 service nova] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e5c170b3-1c26-4874-8199-ad264b18cc6e req-f7a40e29-82b2-4b29-88db-0934785aa616 service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e5c170b3-1c26-4874-8199-ad264b18cc6e req-f7a40e29-82b2-4b29-88db-0934785aa616 service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-e5c170b3-1c26-4874-8199-ad264b18cc6e req-f7a40e29-82b2-4b29-88db-0934785aa616 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] No waiting events found dispatching network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:18 user nova-compute[74582]: WARNING nova.compute.manager [req-e5c170b3-1c26-4874-8199-ad264b18cc6e req-f7a40e29-82b2-4b29-88db-0934785aa616 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received unexpected event network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 for instance with vm_state building and task_state spawning.
Nov 03 13:54:18 user nova-compute[74582]: INFO nova.compute.manager [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Took 6.47 seconds to build instance.
Nov 03 13:54:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7cd54236-ddf4-4a63-8472-c9817352621d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:24 user nova-compute[74582]: INFO nova.compute.manager [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Terminating instance
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-43e6dac8-5211-45d6-b68b-767f283bffe4 req-c8642e5f-e2ba-41e4-ab71-3b738176e08a service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-vif-unplugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43e6dac8-5211-45d6-b68b-767f283bffe4 req-c8642e5f-e2ba-41e4-ab71-3b738176e08a service nova] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43e6dac8-5211-45d6-b68b-767f283bffe4 req-c8642e5f-e2ba-41e4-ab71-3b738176e08a service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43e6dac8-5211-45d6-b68b-767f283bffe4 req-c8642e5f-e2ba-41e4-ab71-3b738176e08a service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-43e6dac8-5211-45d6-b68b-767f283bffe4 req-c8642e5f-e2ba-41e4-ab71-3b738176e08a service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] No waiting events found dispatching network-vif-unplugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-43e6dac8-5211-45d6-b68b-767f283bffe4 req-c8642e5f-e2ba-41e4-ab71-3b738176e08a service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-vif-unplugged-4a75e92f-dc5c-434a-a705-c539a673e831 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Instance destroyed successfully.
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lazy-loading 'resources' on Instance uuid 1294e014-eed1-4016-a1a4-c3977799f4d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1246411133',display_name='tempest-VolumesAdminNegativeTest-server-1246411133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1246411133',id=6,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubD9joA970Za/+EOVKy8WOkZ56ExL5EUJL+5Zb4OisZ399OLrJYn7B5YxmPZFi5VUC2Z5AH8gwodGbQtYpnyT016JX7rwXUfdhFQs+syb5BALGo3vVZmqmPqx0lXGQ8Q==',key_name='tempest-keypair-1002456884',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9789163764134874a379056ee7cf142b',ramdisk_id='',reservation_id='r-z35el5lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-403557302',owner_user_name='tempest-VolumesAdminNegativeTest-403557302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d8a8463e6b44b5a49ada2835baf0d5',uuid=1294e014-eed1-4016-a1a4-c3977799f4d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converting VIF {"id": "4a75e92f-dc5c-434a-a705-c539a673e831", "address": "fa:16:3e:8f:a7:bf", "network": {"id": "4492d10a-402f-4810-a6ef-14c3f7af1810", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1395144492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9789163764134874a379056ee7cf142b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a75e92f-dc", "ovs_interfaceid": "4a75e92f-dc5c-434a-a705-c539a673e831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG os_vif [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a75e92f-dc, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=878ecd20-3992-4013-aed1-c03878003586) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:24 user nova-compute[74582]: INFO os_vif [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=4a75e92f-dc5c-434a-a705-c539a673e831,network=Network(4492d10a-402f-4810-a6ef-14c3f7af1810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a75e92f-dc')
Nov 03 13:54:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Deleting instance files /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4_del
Nov 03 13:54:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Deletion of /opt/stack/data/nova/instances/1294e014-eed1-4016-a1a4-c3977799f4d4_del complete
Nov 03 13:54:24 user nova-compute[74582]: INFO nova.compute.manager [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 13:54:24 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:54:24 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:54:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:25 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:25 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Took 0.86 seconds to deallocate network for instance.
Nov 03 13:54:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f72be3a-0f23-40a8-acbc-52d48249690a req-56a75a81-0944-4fa9-b695-c9037c983c91 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-vif-deleted-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:25 user nova-compute[74582]: INFO nova.compute.manager [req-4f72be3a-0f23-40a8-acbc-52d48249690a req-56a75a81-0944-4fa9-b695-c9037c983c91 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Neutron deleted interface 4a75e92f-dc5c-434a-a705-c539a673e831; detaching it from the instance and deleting it from the info cache
Nov 03 13:54:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-4f72be3a-0f23-40a8-acbc-52d48249690a req-56a75a81-0944-4fa9-b695-c9037c983c91 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f72be3a-0f23-40a8-acbc-52d48249690a req-56a75a81-0944-4fa9-b695-c9037c983c91 service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Detach interface failed, port_id=4a75e92f-dc5c-434a-a705-c539a673e831, reason: Instance 1294e014-eed1-4016-a1a4-c3977799f4d4 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 13:54:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:26 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Deleted allocations for instance 1294e014-eed1-4016-a1a4-c3977799f4d4
Nov 03 13:54:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b5421a3-6e9c-44f9-bb10-90e98cc8dab2 tempest-VolumesAdminNegativeTest-403557302 tempest-VolumesAdminNegativeTest-403557302-project-member] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-994b615f-d3c0-4430-a0d2-098f00941e16 req-21eb62d3-bdc0-4b12-a9cd-0c482b5e376f service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received event network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-994b615f-d3c0-4430-a0d2-098f00941e16 req-21eb62d3-bdc0-4b12-a9cd-0c482b5e376f service nova] Acquiring lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-994b615f-d3c0-4430-a0d2-098f00941e16 req-21eb62d3-bdc0-4b12-a9cd-0c482b5e376f service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-994b615f-d3c0-4430-a0d2-098f00941e16 req-21eb62d3-bdc0-4b12-a9cd-0c482b5e376f service nova] Lock "1294e014-eed1-4016-a1a4-c3977799f4d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-994b615f-d3c0-4430-a0d2-098f00941e16 req-21eb62d3-bdc0-4b12-a9cd-0c482b5e376f service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] No waiting events found dispatching network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:26 user nova-compute[74582]: WARNING nova.compute.manager [req-994b615f-d3c0-4430-a0d2-098f00941e16 req-21eb62d3-bdc0-4b12-a9cd-0c482b5e376f service nova] [instance: 1294e014-eed1-4016-a1a4-c3977799f4d4] Received unexpected event network-vif-plugged-4a75e92f-dc5c-434a-a705-c539a673e831 for instance with vm_state deleted and task_state None.
Nov 03 13:54:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:54:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:36 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:54:36 user nova-compute[74582]: INFO nova.compute.claims [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Claim successful on node user
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:54:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.policy [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f64445061a214d13992b8b3bbacfb0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd438a60c19854c4a93593908fb9b4390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:54:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Creating image(s)
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "/opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk 1073741824" returned: 0 in 0.073s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Successfully created port: 7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Cannot resize image /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Ensure instance console log exists: /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Successfully updated port: 7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquired lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-changed-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Refreshing instance network info cache due to event network-changed-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] Acquiring lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updating instance_info_cache with network_info: [{"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Releasing lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Instance network_info: |[{"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] Acquired lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.neutron [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Refreshing network info cache for port 7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Start _get_guest_xml network_info=[{"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:54:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-35506629',display_name='tempest-AttachVolumeNegativeTest-server-35506629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-35506629',id=17,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7WIZGfLlcXnI3wufzNCaFU4UUIpOs3LkJwg+7GXXcur1LuEX3xH3QppLmkevW9DCYyaQ7jp2jC5NDV+0f12TUNqIvt+tQ6YbhlLc/DWK7AT6uBUyCqP6ZFbQvYekY+ZQ==',key_name='tempest-keypair-1683901516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-wyp8cyl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=24e90b05-29db-4dbd-8916-be21cfcc4041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.objects.instance [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'pci_devices' on Instance uuid 24e90b05-29db-4dbd-8916-be21cfcc4041 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:54:39 user nova-compute[74582]:   <uuid>24e90b05-29db-4dbd-8916-be21cfcc4041</uuid>
Nov 03 13:54:39 user nova-compute[74582]:   <name>instance-00000011</name>
Nov 03 13:54:39 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:54:39 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:54:39 user nova-compute[74582]:   <metadata>
Nov 03 13:54:39 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:54:39 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:54:39 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeNegativeTest-server-35506629</nova:name>
Nov 03 13:54:39 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:54:39</nova:creationTime>
Nov 03 13:54:39 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:54:39 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:54:39 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:54:39 user nova-compute[74582]:       <nova:owner>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:user uuid="f64445061a214d13992b8b3bbacfb0c0">tempest-AttachVolumeNegativeTest-1460772866-project-member</nova:user>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:project uuid="d438a60c19854c4a93593908fb9b4390">tempest-AttachVolumeNegativeTest-1460772866</nova:project>
Nov 03 13:54:39 user nova-compute[74582]:       </nova:owner>
Nov 03 13:54:39 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:54:39 user nova-compute[74582]:       <nova:ports>
Nov 03 13:54:39 user nova-compute[74582]:         <nova:port uuid="7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec">
Nov 03 13:54:39 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 13:54:39 user nova-compute[74582]:         </nova:port>
Nov 03 13:54:39 user nova-compute[74582]:       </nova:ports>
Nov 03 13:54:39 user nova-compute[74582]:     </nova:instance>
Nov 03 13:54:39 user nova-compute[74582]:   </metadata>
Nov 03 13:54:39 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:54:39 user nova-compute[74582]:     <system>
Nov 03 13:54:39 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:54:39 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:54:39 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:54:39 user nova-compute[74582]:       <entry name="serial">24e90b05-29db-4dbd-8916-be21cfcc4041</entry>
Nov 03 13:54:39 user nova-compute[74582]:       <entry name="uuid">24e90b05-29db-4dbd-8916-be21cfcc4041</entry>
Nov 03 13:54:39 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:54:39 user nova-compute[74582]:     </system>
Nov 03 13:54:39 user nova-compute[74582]:   </sysinfo>
Nov 03 13:54:39 user nova-compute[74582]:   <os>
Nov 03 13:54:39 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:54:39 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:54:39 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:54:39 user nova-compute[74582]:   </os>
Nov 03 13:54:39 user nova-compute[74582]:   <features>
Nov 03 13:54:39 user nova-compute[74582]:     <acpi/>
Nov 03 13:54:39 user nova-compute[74582]:     <apic/>
Nov 03 13:54:39 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:54:39 user nova-compute[74582]:   </features>
Nov 03 13:54:39 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:54:39 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:54:39 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:54:39 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:54:39 user nova-compute[74582]:   </clock>
Nov 03 13:54:39 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:54:39 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:54:39 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:54:39 user nova-compute[74582]:   </cpu>
Nov 03 13:54:39 user nova-compute[74582]:   <devices>
Nov 03 13:54:39 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:54:39 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:54:39 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk"/>
Nov 03 13:54:39 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:54:39 user nova-compute[74582]:     </disk>
Nov 03 13:54:39 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:54:39 user nova-compute[74582]:       <mac address="fa:16:3e:d1:66:2f"/>
Nov 03 13:54:39 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:54:39 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:54:39 user nova-compute[74582]:       <target dev="tap7a9cbcc2-99"/>
Nov 03 13:54:39 user nova-compute[74582]:     </interface>
Nov 03 13:54:39 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:54:39 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/console.log" append="off"/>
Nov 03 13:54:39 user nova-compute[74582]:     </serial>
Nov 03 13:54:39 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:54:39 user nova-compute[74582]:     <video>
Nov 03 13:54:39 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:54:39 user nova-compute[74582]:     </video>
Nov 03 13:54:39 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:54:39 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:54:39 user nova-compute[74582]:     </rng>
Nov 03 13:54:39 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:54:39 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:54:39 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:54:39 user nova-compute[74582]:     </memballoon>
Nov 03 13:54:39 user nova-compute[74582]:   </devices>
Nov 03 13:54:39 user nova-compute[74582]: </domain>
Nov 03 13:54:39 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-35506629',display_name='tempest-AttachVolumeNegativeTest-server-35506629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-35506629',id=17,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7WIZGfLlcXnI3wufzNCaFU4UUIpOs3LkJwg+7GXXcur1LuEX3xH3QppLmkevW9DCYyaQ7jp2jC5NDV+0f12TUNqIvt+tQ6YbhlLc/DWK7AT6uBUyCqP6ZFbQvYekY+ZQ==',key_name='tempest-keypair-1683901516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-wyp8cyl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=24e90b05-29db-4dbd-8916-be21cfcc4041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG os_vif [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b5a909f-3501-5f13-b7fb-bab26054bfc0', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9cbcc2-99, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a9cbcc2-99, col_values=(('qos', UUID('ae5b9ced-21eb-41f5-ab16-ff570c22ad60')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a9cbcc2-99, col_values=(('external_ids', {'iface-id': '7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:66:2f', 'vm-uuid': '24e90b05-29db-4dbd-8916-be21cfcc4041'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:39 user nova-compute[74582]: INFO os_vif [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99')
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:d1:66:2f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.neutron [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updated VIF entry in instance network info cache for port 7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG nova.network.neutron [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updating instance_info_cache with network_info: [{"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7f2ac8e1-e504-467d-a596-5e636a256752 req-5802eb36-c0c0-4ea0-b7f5-9a528d8d1d42 service nova] Releasing lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-b9882d8e-dee4-482b-a73b-8c297a036e0a req-fb1d18cb-03a7-4c40-ad00-73925360e752 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b9882d8e-dee4-482b-a73b-8c297a036e0a req-fb1d18cb-03a7-4c40-ad00-73925360e752 service nova] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b9882d8e-dee4-482b-a73b-8c297a036e0a req-fb1d18cb-03a7-4c40-ad00-73925360e752 service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b9882d8e-dee4-482b-a73b-8c297a036e0a req-fb1d18cb-03a7-4c40-ad00-73925360e752 service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-b9882d8e-dee4-482b-a73b-8c297a036e0a req-fb1d18cb-03a7-4c40-ad00-73925360e752 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] No waiting events found dispatching network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:41 user nova-compute[74582]: WARNING nova.compute.manager [req-b9882d8e-dee4-482b-a73b-8c297a036e0a req-fb1d18cb-03a7-4c40-ad00-73925360e752 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received unexpected event network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec for instance with vm_state building and task_state spawning.
Nov 03 13:54:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:54:42 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Instance spawned successfully.
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-382cc868-ed47-4fe7-bd3a-098f1a30ec65 req-290f3bfc-2e3d-458f-966c-a9eb7804ca2b service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-382cc868-ed47-4fe7-bd3a-098f1a30ec65 req-290f3bfc-2e3d-458f-966c-a9eb7804ca2b service nova] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-382cc868-ed47-4fe7-bd3a-098f1a30ec65 req-290f3bfc-2e3d-458f-966c-a9eb7804ca2b service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-382cc868-ed47-4fe7-bd3a-098f1a30ec65 req-290f3bfc-2e3d-458f-966c-a9eb7804ca2b service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-382cc868-ed47-4fe7-bd3a-098f1a30ec65 req-290f3bfc-2e3d-458f-966c-a9eb7804ca2b service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] No waiting events found dispatching network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:43 user nova-compute[74582]: WARNING nova.compute.manager [req-382cc868-ed47-4fe7-bd3a-098f1a30ec65 req-290f3bfc-2e3d-458f-966c-a9eb7804ca2b service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received unexpected event network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec for instance with vm_state building and task_state spawning.
Nov 03 13:54:43 user nova-compute[74582]: INFO nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 03 13:54:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:54:43 user nova-compute[74582]: INFO nova.compute.manager [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Took 6.44 seconds to build instance.
Nov 03 13:54:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-787d6f18-6880-422b-84df-489cc18cd725 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.551s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:54:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:47 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:54:47 user nova-compute[74582]: INFO nova.compute.claims [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Claim successful on node user
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:54:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.policy [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2857caf27f24ebc895421391f498e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1d4212d1484dd1b416342134f844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:54:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Creating image(s)
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:48 user nova-compute[74582]: INFO nova.compute.manager [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Unrescuing
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG nova.network.neutron [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.221s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.226s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk 1073741824" returned: 0 in 0.060s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Successfully created port: f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'flavor' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Cannot resize image /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Ensure instance console log exists: /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-422f0f6a-54ed-4cc8-84ba-f32358377cea req-53445433-f16f-427c-8f9f-4d762491a996 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-422f0f6a-54ed-4cc8-84ba-f32358377cea req-53445433-f16f-427c-8f9f-4d762491a996 service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-422f0f6a-54ed-4cc8-84ba-f32358377cea req-53445433-f16f-427c-8f9f-4d762491a996 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-422f0f6a-54ed-4cc8-84ba-f32358377cea req-53445433-f16f-427c-8f9f-4d762491a996 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-422f0f6a-54ed-4cc8-84ba-f32358377cea req-53445433-f16f-427c-8f9f-4d762491a996 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:49 user nova-compute[74582]: WARNING nova.compute.manager [req-422f0f6a-54ed-4cc8-84ba-f32358377cea req-53445433-f16f-427c-8f9f-4d762491a996 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state rescued and task_state unrescuing.
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Successfully updated port: f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing instance network info cache due to event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance network_info: |[{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.neutron [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Start _get_guest_xml network_info=[{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:54:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-502419754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-502419754',id=18,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbwD9gJs2yXcQqIFtwatq0hM5ER3YUvbIs0UFXyxEDym93nkGFlja9k2K82n/AvThRa46w8f06lOrGscGtpT3OwMB0tPSvkAtB+MdezDAYpTMxZCeZQS5gruMqCIHf9bQ==',key_name='tempest-keypair-954096694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-2b67zupc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=d9bac93a-31ea-411d-868a-0afb4ff56880,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'pci_devices' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:54:50 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance destroyed successfully.
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:54:50 user nova-compute[74582]:   <uuid>d9bac93a-31ea-411d-868a-0afb4ff56880</uuid>
Nov 03 13:54:50 user nova-compute[74582]:   <name>instance-00000012</name>
Nov 03 13:54:50 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:54:50 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:54:50 user nova-compute[74582]:   <metadata>
Nov 03 13:54:50 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:54:50 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:54:50 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-502419754</nova:name>
Nov 03 13:54:50 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:54:50</nova:creationTime>
Nov 03 13:54:50 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:54:50 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:54:50 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:54:50 user nova-compute[74582]:       <nova:owner>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:user uuid="b2857caf27f24ebc895421391f498e01">tempest-AttachVolumeShelveTestJSON-1103257092-project-member</nova:user>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:project uuid="9f1d4212d1484dd1b416342134f844e0">tempest-AttachVolumeShelveTestJSON-1103257092</nova:project>
Nov 03 13:54:50 user nova-compute[74582]:       </nova:owner>
Nov 03 13:54:50 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:54:50 user nova-compute[74582]:       <nova:ports>
Nov 03 13:54:50 user nova-compute[74582]:         <nova:port uuid="f2e2cdf8-b6d0-4d51-b766-518d8ac3915a">
Nov 03 13:54:50 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:54:50 user nova-compute[74582]:         </nova:port>
Nov 03 13:54:50 user nova-compute[74582]:       </nova:ports>
Nov 03 13:54:50 user nova-compute[74582]:     </nova:instance>
Nov 03 13:54:50 user nova-compute[74582]:   </metadata>
Nov 03 13:54:50 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:54:50 user nova-compute[74582]:     <system>
Nov 03 13:54:50 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:54:50 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:54:50 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:54:50 user nova-compute[74582]:       <entry name="serial">d9bac93a-31ea-411d-868a-0afb4ff56880</entry>
Nov 03 13:54:50 user nova-compute[74582]:       <entry name="uuid">d9bac93a-31ea-411d-868a-0afb4ff56880</entry>
Nov 03 13:54:50 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:54:50 user nova-compute[74582]:     </system>
Nov 03 13:54:50 user nova-compute[74582]:   </sysinfo>
Nov 03 13:54:50 user nova-compute[74582]:   <os>
Nov 03 13:54:50 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:54:50 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:54:50 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:54:50 user nova-compute[74582]:   </os>
Nov 03 13:54:50 user nova-compute[74582]:   <features>
Nov 03 13:54:50 user nova-compute[74582]:     <acpi/>
Nov 03 13:54:50 user nova-compute[74582]:     <apic/>
Nov 03 13:54:50 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:54:50 user nova-compute[74582]:   </features>
Nov 03 13:54:50 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:54:50 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:54:50 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:54:50 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:54:50 user nova-compute[74582]:   </clock>
Nov 03 13:54:50 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:54:50 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:54:50 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:54:50 user nova-compute[74582]:   </cpu>
Nov 03 13:54:50 user nova-compute[74582]:   <devices>
Nov 03 13:54:50 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:54:50 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:54:50 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk"/>
Nov 03 13:54:50 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:54:50 user nova-compute[74582]:     </disk>
Nov 03 13:54:50 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:54:50 user nova-compute[74582]:       <mac address="fa:16:3e:df:d8:bc"/>
Nov 03 13:54:50 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:54:50 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:54:50 user nova-compute[74582]:       <target dev="tapf2e2cdf8-b6"/>
Nov 03 13:54:50 user nova-compute[74582]:     </interface>
Nov 03 13:54:50 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:54:50 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/console.log" append="off"/>
Nov 03 13:54:50 user nova-compute[74582]:     </serial>
Nov 03 13:54:50 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:54:50 user nova-compute[74582]:     <video>
Nov 03 13:54:50 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:54:50 user nova-compute[74582]:     </video>
Nov 03 13:54:50 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:54:50 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:54:50 user nova-compute[74582]:     </rng>
Nov 03 13:54:50 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:54:50 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:54:50 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:54:50 user nova-compute[74582]:     </memballoon>
Nov 03 13:54:50 user nova-compute[74582]:   </devices>
Nov 03 13:54:50 user nova-compute[74582]: </domain>
Nov 03 13:54:50 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-502419754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-502419754',id=18,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbwD9gJs2yXcQqIFtwatq0hM5ER3YUvbIs0UFXyxEDym93nkGFlja9k2K82n/AvThRa46w8f06lOrGscGtpT3OwMB0tPSvkAtB+MdezDAYpTMxZCeZQS5gruMqCIHf9bQ==',key_name='tempest-keypair-954096694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-2b67zupc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=d9bac93a-31ea-411d-868a-0afb4ff56880,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG os_vif [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92ffb31a-7d3b-50c5-8ac3-3c14a5aa7274', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2e2cdf8-b6, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2e2cdf8-b6, col_values=(('qos', UUID('1c0abed1-e754-4cda-8cbd-68db078150a2')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2e2cdf8-b6, col_values=(('external_ids', {'iface-id': 'f2e2cdf8-b6d0-4d51-b766-518d8ac3915a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:d8:bc', 'vm-uuid': 'd9bac93a-31ea-411d-868a-0afb4ff56880'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: INFO os_vif [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6')
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No VIF found with MAC fa:16:3e:df:d8:bc, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.neutron [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updated VIF entry in instance network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG nova.network.neutron [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3da108ff-3898-4d0c-8118-f89749075334 req-8b1c5fae-1b38-4c18-90c4-73de68e5c43d service nova] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-8e9d79e6-cd03-4fd4-8a3f-294c70e35669 req-f061d886-3f19-4f84-a249-0431fe49c0d3 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8e9d79e6-cd03-4fd4-8a3f-294c70e35669 req-f061d886-3f19-4f84-a249-0431fe49c0d3 service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8e9d79e6-cd03-4fd4-8a3f-294c70e35669 req-f061d886-3f19-4f84-a249-0431fe49c0d3 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8e9d79e6-cd03-4fd4-8a3f-294c70e35669 req-f061d886-3f19-4f84-a249-0431fe49c0d3 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-8e9d79e6-cd03-4fd4-8a3f-294c70e35669 req-f061d886-3f19-4f84-a249-0431fe49c0d3 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:51 user nova-compute[74582]: WARNING nova.compute.manager [req-8e9d79e6-cd03-4fd4-8a3f-294c70e35669 req-f061d886-3f19-4f84-a249-0431fe49c0d3 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state rescued and task_state unrescuing.
Nov 03 13:54:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:54:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-28a8c0f8-0bad-4401-b972-ecd14ab938ba req-68c767a4-930f-4d6a-8634-305c106b3c63 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28a8c0f8-0bad-4401-b972-ecd14ab938ba req-68c767a4-930f-4d6a-8634-305c106b3c63 service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28a8c0f8-0bad-4401-b972-ecd14ab938ba req-68c767a4-930f-4d6a-8634-305c106b3c63 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28a8c0f8-0bad-4401-b972-ecd14ab938ba req-68c767a4-930f-4d6a-8634-305c106b3c63 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-28a8c0f8-0bad-4401-b972-ecd14ab938ba req-68c767a4-930f-4d6a-8634-305c106b3c63 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:53 user nova-compute[74582]: WARNING nova.compute.manager [req-28a8c0f8-0bad-4401-b972-ecd14ab938ba req-68c767a4-930f-4d6a-8634-305c106b3c63 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state building and task_state spawning.
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:53 user nova-compute[74582]: WARNING nova.compute.manager [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state rescued and task_state unrescuing.
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:53 user nova-compute[74582]: WARNING nova.compute.manager [req-b30d82bc-b794-40d6-b8b7-4ad9cd3840c0 req-92d53f78-902d-4b29-bc28-9d877ccdb941 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state rescued and task_state unrescuing.
Nov 03 13:54:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-63536f4f-f14a-4fc4-8535-32585a7b44e1 req-f7d8f876-592a-4a41-9b3b-e3e820fe9abf service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63536f4f-f14a-4fc4-8535-32585a7b44e1 req-f7d8f876-592a-4a41-9b3b-e3e820fe9abf service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63536f4f-f14a-4fc4-8535-32585a7b44e1 req-f7d8f876-592a-4a41-9b3b-e3e820fe9abf service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63536f4f-f14a-4fc4-8535-32585a7b44e1 req-f7d8f876-592a-4a41-9b3b-e3e820fe9abf service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-63536f4f-f14a-4fc4-8535-32585a7b44e1 req-f7d8f876-592a-4a41-9b3b-e3e820fe9abf service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:54:55 user nova-compute[74582]: WARNING nova.compute.manager [req-63536f4f-f14a-4fc4-8535-32585a7b44e1 req-f7d8f876-592a-4a41-9b3b-e3e820fe9abf service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state building and task_state spawning.
Nov 03 13:54:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-b2ef5b70-e7ef-4c8a-be5b-3355d8bbb3b6 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:54:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance spawned successfully.
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:55 user nova-compute[74582]: INFO nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Took 7.36 seconds to spawn the instance on the hypervisor.
Nov 03 13:54:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:54:56 user nova-compute[74582]: INFO nova.compute.manager [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Took 8.14 seconds to build instance.
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d4f1e77e-6c98-4136-a48d-515b42d103f5 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.263s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:54:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:54:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8114MB free_disk=25.48291015625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 24e90b05-29db-4dbd-8916-be21cfcc4041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d9bac93a-31ea-411d-868a-0afb4ff56880 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:54:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:54:58 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:55:17 user nova-compute[74582]: INFO nova.compute.claims [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Claim successful on node user
Nov 03 13:55:17 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:55:17 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.967s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:55:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.policy [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9062b4b5f9e46b7b25106e57e867533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84669f27ef642dd9f95e40554305974', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:55:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Creating image(s)
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "/opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "/opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.245s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk 1073741824" returned: 0 in 0.148s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Successfully created port: 22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Cannot resize image /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Ensure instance console log exists: /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Successfully updated port: 22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquired lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.compute.manager [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-changed-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.compute.manager [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Refreshing instance network info cache due to event network-changed-22fd01bb-5579-4223-bd50-d9b77f11f886. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] Acquiring lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updating instance_info_cache with network_info: [{"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Releasing lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Instance network_info: |[{"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] Acquired lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.network.neutron [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Refreshing network info cache for port 22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Start _get_guest_xml network_info=[{"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:55:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1943440139',display_name='tempest-TestServerVolumeAttachmentScenario-server-1943440139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1943440139',id=19,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrR+rYEpEH7BxPrZCihb5r4SP8bidG4iM8ZarOTxQ14mEap44GlXlzHq8UwkdkLT9Qha9KabLiU2o/I8xaN4EtEF5UNyaWuoechrDIrAGQb7EMqBufPOeuML8jIXxHLng==',key_name='tempest-keypair-1893500520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c84669f27ef642dd9f95e40554305974',ramdisk_id='',reservation_id='r-1yg5e0ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-395164084',owner_user_name='tempest-TestServerVolumeAttachmentScenario-395164084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9062b4b5f9e46b7b25106e57e867533',uuid=5f2c5d0f-68d6-43b6-803f-6273a2797147,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Converting VIF {"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:55:20 user nova-compute[74582]:   <uuid>5f2c5d0f-68d6-43b6-803f-6273a2797147</uuid>
Nov 03 13:55:20 user nova-compute[74582]:   <name>instance-00000013</name>
Nov 03 13:55:20 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:55:20 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:55:20 user nova-compute[74582]:   <metadata>
Nov 03 13:55:20 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:55:20 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:55:20 user nova-compute[74582]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1943440139</nova:name>
Nov 03 13:55:20 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:55:20</nova:creationTime>
Nov 03 13:55:20 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:55:20 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:55:20 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:55:20 user nova-compute[74582]:       <nova:owner>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:user uuid="f9062b4b5f9e46b7b25106e57e867533">tempest-TestServerVolumeAttachmentScenario-395164084-project-member</nova:user>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:project uuid="c84669f27ef642dd9f95e40554305974">tempest-TestServerVolumeAttachmentScenario-395164084</nova:project>
Nov 03 13:55:20 user nova-compute[74582]:       </nova:owner>
Nov 03 13:55:20 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:55:20 user nova-compute[74582]:       <nova:ports>
Nov 03 13:55:20 user nova-compute[74582]:         <nova:port uuid="22fd01bb-5579-4223-bd50-d9b77f11f886">
Nov 03 13:55:20 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 13:55:20 user nova-compute[74582]:         </nova:port>
Nov 03 13:55:20 user nova-compute[74582]:       </nova:ports>
Nov 03 13:55:20 user nova-compute[74582]:     </nova:instance>
Nov 03 13:55:20 user nova-compute[74582]:   </metadata>
Nov 03 13:55:20 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:55:20 user nova-compute[74582]:     <system>
Nov 03 13:55:20 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:55:20 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:55:20 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:55:20 user nova-compute[74582]:       <entry name="serial">5f2c5d0f-68d6-43b6-803f-6273a2797147</entry>
Nov 03 13:55:20 user nova-compute[74582]:       <entry name="uuid">5f2c5d0f-68d6-43b6-803f-6273a2797147</entry>
Nov 03 13:55:20 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:55:20 user nova-compute[74582]:     </system>
Nov 03 13:55:20 user nova-compute[74582]:   </sysinfo>
Nov 03 13:55:20 user nova-compute[74582]:   <os>
Nov 03 13:55:20 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:55:20 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:55:20 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:55:20 user nova-compute[74582]:   </os>
Nov 03 13:55:20 user nova-compute[74582]:   <features>
Nov 03 13:55:20 user nova-compute[74582]:     <acpi/>
Nov 03 13:55:20 user nova-compute[74582]:     <apic/>
Nov 03 13:55:20 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:55:20 user nova-compute[74582]:   </features>
Nov 03 13:55:20 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:55:20 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:55:20 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:55:20 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:55:20 user nova-compute[74582]:   </clock>
Nov 03 13:55:20 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:55:20 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:55:20 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:55:20 user nova-compute[74582]:   </cpu>
Nov 03 13:55:20 user nova-compute[74582]:   <devices>
Nov 03 13:55:20 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:55:20 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:55:20 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk"/>
Nov 03 13:55:20 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:55:20 user nova-compute[74582]:     </disk>
Nov 03 13:55:20 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:55:20 user nova-compute[74582]:       <mac address="fa:16:3e:08:d4:84"/>
Nov 03 13:55:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:20 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:55:20 user nova-compute[74582]:       <target dev="tap22fd01bb-55"/>
Nov 03 13:55:20 user nova-compute[74582]:     </interface>
Nov 03 13:55:20 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:55:20 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/console.log" append="off"/>
Nov 03 13:55:20 user nova-compute[74582]:     </serial>
Nov 03 13:55:20 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:55:20 user nova-compute[74582]:     <video>
Nov 03 13:55:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:20 user nova-compute[74582]:     </video>
Nov 03 13:55:20 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:55:20 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:55:20 user nova-compute[74582]:     </rng>
Nov 03 13:55:20 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:55:20 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:55:20 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:55:20 user nova-compute[74582]:     </memballoon>
Nov 03 13:55:20 user nova-compute[74582]:   </devices>
Nov 03 13:55:20 user nova-compute[74582]: </domain>
Nov 03 13:55:20 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1943440139',display_name='tempest-TestServerVolumeAttachmentScenario-server-1943440139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1943440139',id=19,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrR+rYEpEH7BxPrZCihb5r4SP8bidG4iM8ZarOTxQ14mEap44GlXlzHq8UwkdkLT9Qha9KabLiU2o/I8xaN4EtEF5UNyaWuoechrDIrAGQb7EMqBufPOeuML8jIXxHLng==',key_name='tempest-keypair-1893500520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c84669f27ef642dd9f95e40554305974',ramdisk_id='',reservation_id='r-1yg5e0ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-395164084',owner_user_name='tempest-TestServerVolumeAttachmentScenario-395164084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9062b4b5f9e46b7b25106e57e867533',uuid=5f2c5d0f-68d6-43b6-803f-6273a2797147,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Converting VIF {"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG os_vif [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8f12131-0677-5110-85fb-ac1086468b0f', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22fd01bb-55, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22fd01bb-55, col_values=(('qos', UUID('4c43aaa1-4de5-4796-ad06-1f4577ddc001')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22fd01bb-55, col_values=(('external_ids', {'iface-id': '22fd01bb-5579-4223-bd50-d9b77f11f886', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:d4:84', 'vm-uuid': '5f2c5d0f-68d6-43b6-803f-6273a2797147'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:20 user nova-compute[74582]: INFO os_vif [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55')
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No VIF found with MAC fa:16:3e:08:d4:84, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:55:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updated VIF entry in instance network info cache for port 22fd01bb-5579-4223-bd50-d9b77f11f886. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:55:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updating instance_info_cache with network_info: [{"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3933e1f8-ca99-49bd-ad5b-f74fd010aac1 req-2a0156f8-1146-45cd-806e-08485c772b93 service nova] Releasing lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae8ec2e4-1943-4409-b884-d8f51ff74f00 req-67ba58b4-a4a3-41c6-bf41-e3da81f06a47 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae8ec2e4-1943-4409-b884-d8f51ff74f00 req-67ba58b4-a4a3-41c6-bf41-e3da81f06a47 service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae8ec2e4-1943-4409-b884-d8f51ff74f00 req-67ba58b4-a4a3-41c6-bf41-e3da81f06a47 service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae8ec2e4-1943-4409-b884-d8f51ff74f00 req-67ba58b4-a4a3-41c6-bf41-e3da81f06a47 service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae8ec2e4-1943-4409-b884-d8f51ff74f00 req-67ba58b4-a4a3-41c6-bf41-e3da81f06a47 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:22 user nova-compute[74582]: WARNING nova.compute.manager [req-ae8ec2e4-1943-4409-b884-d8f51ff74f00 req-67ba58b4-a4a3-41c6-bf41-e3da81f06a47 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received unexpected event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with vm_state building and task_state spawning.
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:55:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Instance spawned successfully.
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:24 user nova-compute[74582]: INFO nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:55:24 user nova-compute[74582]: INFO nova.compute.manager [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Took 7.40 seconds to build instance.
Nov 03 13:55:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-444af540-0def-4350-93f1-d49ef5d008fd tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.521s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-1febac66-010e-4f21-b877-4db5633dbf89 req-4e52e265-656d-4b03-8b18-bc026059459e service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1febac66-010e-4f21-b877-4db5633dbf89 req-4e52e265-656d-4b03-8b18-bc026059459e service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1febac66-010e-4f21-b877-4db5633dbf89 req-4e52e265-656d-4b03-8b18-bc026059459e service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1febac66-010e-4f21-b877-4db5633dbf89 req-4e52e265-656d-4b03-8b18-bc026059459e service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-1febac66-010e-4f21-b877-4db5633dbf89 req-4e52e265-656d-4b03-8b18-bc026059459e service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:24 user nova-compute[74582]: WARNING nova.compute.manager [req-1febac66-010e-4f21-b877-4db5633dbf89 req-4e52e265-656d-4b03-8b18-bc026059459e service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received unexpected event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with vm_state active and task_state None.
Nov 03 13:55:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:55:26 user nova-compute[74582]: INFO nova.compute.claims [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Claim successful on node user
Nov 03 13:55:26 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:55:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.policy [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff612186715a41698e5f6e1bf303556c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be382af3f93a4c059e06948158154021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:55:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Creating image(s)
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "/opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "/opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "/opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.215s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk 1073741824" returned: 0 in 0.060s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Successfully created port: 85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.219s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:55:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Cannot resize image /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Ensure instance console log exists: /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Successfully updated port: 85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "refresh_cache-62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquired lock "refresh_cache-62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-changed-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Refreshing instance network info cache due to event network-changed-85877288-7474-44d9-8454-d66125ebe733. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] Acquiring lock "refresh_cache-62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Updating instance_info_cache with network_info: [{"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Releasing lock "refresh_cache-62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Instance network_info: |[{"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] Acquired lock "refresh_cache-62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Refreshing network info cache for port 85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Start _get_guest_xml network_info=[{"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:55:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:55:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-96593101',display_name='tempest-DeleteServersTestJSON-server-96593101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-96593101',id=20,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be382af3f93a4c059e06948158154021',ramdisk_id='',reservation_id='r-knkbtqvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-835112284',owner_user_name='tempest-DeleteServersTestJSON-835112284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:27Z,user_data=None,user_id='ff612186715a41698e5f6e1bf303556c',uuid=62e9d1f4-c70d-4557-b3a4-fbfca22a1aed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Converting VIF {"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:55:29 user nova-compute[74582]:   <uuid>62e9d1f4-c70d-4557-b3a4-fbfca22a1aed</uuid>
Nov 03 13:55:29 user nova-compute[74582]:   <name>instance-00000014</name>
Nov 03 13:55:29 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:55:29 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:55:29 user nova-compute[74582]:   <metadata>
Nov 03 13:55:29 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:55:29 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:55:29 user nova-compute[74582]:       <nova:name>tempest-DeleteServersTestJSON-server-96593101</nova:name>
Nov 03 13:55:29 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:55:28</nova:creationTime>
Nov 03 13:55:29 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:55:29 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:55:29 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:55:29 user nova-compute[74582]:       <nova:owner>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:user uuid="ff612186715a41698e5f6e1bf303556c">tempest-DeleteServersTestJSON-835112284-project-member</nova:user>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:project uuid="be382af3f93a4c059e06948158154021">tempest-DeleteServersTestJSON-835112284</nova:project>
Nov 03 13:55:29 user nova-compute[74582]:       </nova:owner>
Nov 03 13:55:29 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:55:29 user nova-compute[74582]:       <nova:ports>
Nov 03 13:55:29 user nova-compute[74582]:         <nova:port uuid="85877288-7474-44d9-8454-d66125ebe733">
Nov 03 13:55:29 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 13:55:29 user nova-compute[74582]:         </nova:port>
Nov 03 13:55:29 user nova-compute[74582]:       </nova:ports>
Nov 03 13:55:29 user nova-compute[74582]:     </nova:instance>
Nov 03 13:55:29 user nova-compute[74582]:   </metadata>
Nov 03 13:55:29 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:55:29 user nova-compute[74582]:     <system>
Nov 03 13:55:29 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:55:29 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:55:29 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:55:29 user nova-compute[74582]:       <entry name="serial">62e9d1f4-c70d-4557-b3a4-fbfca22a1aed</entry>
Nov 03 13:55:29 user nova-compute[74582]:       <entry name="uuid">62e9d1f4-c70d-4557-b3a4-fbfca22a1aed</entry>
Nov 03 13:55:29 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:55:29 user nova-compute[74582]:     </system>
Nov 03 13:55:29 user nova-compute[74582]:   </sysinfo>
Nov 03 13:55:29 user nova-compute[74582]:   <os>
Nov 03 13:55:29 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:55:29 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:55:29 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:55:29 user nova-compute[74582]:   </os>
Nov 03 13:55:29 user nova-compute[74582]:   <features>
Nov 03 13:55:29 user nova-compute[74582]:     <acpi/>
Nov 03 13:55:29 user nova-compute[74582]:     <apic/>
Nov 03 13:55:29 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:55:29 user nova-compute[74582]:   </features>
Nov 03 13:55:29 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:55:29 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:55:29 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:55:29 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:55:29 user nova-compute[74582]:   </clock>
Nov 03 13:55:29 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:55:29 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:55:29 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:55:29 user nova-compute[74582]:   </cpu>
Nov 03 13:55:29 user nova-compute[74582]:   <devices>
Nov 03 13:55:29 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:55:29 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:55:29 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk"/>
Nov 03 13:55:29 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:55:29 user nova-compute[74582]:     </disk>
Nov 03 13:55:29 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:55:29 user nova-compute[74582]:       <mac address="fa:16:3e:13:c8:ec"/>
Nov 03 13:55:29 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:29 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:55:29 user nova-compute[74582]:       <target dev="tap85877288-74"/>
Nov 03 13:55:29 user nova-compute[74582]:     </interface>
Nov 03 13:55:29 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:55:29 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/console.log" append="off"/>
Nov 03 13:55:29 user nova-compute[74582]:     </serial>
Nov 03 13:55:29 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:55:29 user nova-compute[74582]:     <video>
Nov 03 13:55:29 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:29 user nova-compute[74582]:     </video>
Nov 03 13:55:29 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:55:29 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:55:29 user nova-compute[74582]:     </rng>
Nov 03 13:55:29 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:55:29 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:55:29 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:55:29 user nova-compute[74582]:     </memballoon>
Nov 03 13:55:29 user nova-compute[74582]:   </devices>
Nov 03 13:55:29 user nova-compute[74582]: </domain>
Nov 03 13:55:29 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-96593101',display_name='tempest-DeleteServersTestJSON-server-96593101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-96593101',id=20,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be382af3f93a4c059e06948158154021',ramdisk_id='',reservation_id='r-knkbtqvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-835112284',owner_user_name='tempest-DeleteServersTestJSON-835112284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:27Z,user_data=None,user_id='ff612186715a41698e5f6e1bf303556c',uuid=62e9d1f4-c70d-4557-b3a4-fbfca22a1aed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Converting VIF {"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG os_vif [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd98cb8b-783f-5104-9a91-441e198ec222', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85877288-74, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85877288-74, col_values=(('qos', UUID('b2348067-a281-46e0-b17e-6203a7092ef1')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85877288-74, col_values=(('external_ids', {'iface-id': '85877288-7474-44d9-8454-d66125ebe733', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:c8:ec', 'vm-uuid': '62e9d1f4-c70d-4557-b3a4-fbfca22a1aed'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:29 user nova-compute[74582]: INFO os_vif [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74')
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] No VIF found with MAC fa:16:3e:13:c8:ec, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.network.neutron [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Updated VIF entry in instance network info cache for port 85877288-7474-44d9-8454-d66125ebe733. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG nova.network.neutron [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Updating instance_info_cache with network_info: [{"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c4e6bbd5-89eb-4ff4-b302-8415d64d3ed1 req-76d94466-b942-43cc-b605-75c57ea3341d service nova] Releasing lock "refresh_cache-62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-13d65f5b-d816-418a-9ef2-d769b982c3fd req-599eed0f-8304-421b-9429-e807550a7112 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13d65f5b-d816-418a-9ef2-d769b982c3fd req-599eed0f-8304-421b-9429-e807550a7112 service nova] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13d65f5b-d816-418a-9ef2-d769b982c3fd req-599eed0f-8304-421b-9429-e807550a7112 service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13d65f5b-d816-418a-9ef2-d769b982c3fd req-599eed0f-8304-421b-9429-e807550a7112 service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-13d65f5b-d816-418a-9ef2-d769b982c3fd req-599eed0f-8304-421b-9429-e807550a7112 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] No waiting events found dispatching network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:31 user nova-compute[74582]: WARNING nova.compute.manager [req-13d65f5b-d816-418a-9ef2-d769b982c3fd req-599eed0f-8304-421b-9429-e807550a7112 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received unexpected event network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 for instance with vm_state building and task_state spawning.
Nov 03 13:55:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:55:33 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Instance spawned successfully.
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-8af37da1-e8d3-4f09-83a8-04b6ac1d437a req-30268e80-eb32-4fe5-b4f9-94f5db5bf00f service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8af37da1-e8d3-4f09-83a8-04b6ac1d437a req-30268e80-eb32-4fe5-b4f9-94f5db5bf00f service nova] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8af37da1-e8d3-4f09-83a8-04b6ac1d437a req-30268e80-eb32-4fe5-b4f9-94f5db5bf00f service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8af37da1-e8d3-4f09-83a8-04b6ac1d437a req-30268e80-eb32-4fe5-b4f9-94f5db5bf00f service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-8af37da1-e8d3-4f09-83a8-04b6ac1d437a req-30268e80-eb32-4fe5-b4f9-94f5db5bf00f service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] No waiting events found dispatching network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:33 user nova-compute[74582]: WARNING nova.compute.manager [req-8af37da1-e8d3-4f09-83a8-04b6ac1d437a req-30268e80-eb32-4fe5-b4f9-94f5db5bf00f service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received unexpected event network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 for instance with vm_state building and task_state spawning.
Nov 03 13:55:33 user nova-compute[74582]: INFO nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 03 13:55:33 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:55:33 user nova-compute[74582]: INFO nova.compute.manager [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Took 7.15 seconds to build instance.
Nov 03 13:55:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c6f92763-4c3a-4e72-ab9f-681f01c35c3e tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.317s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:55:50 user nova-compute[74582]: INFO nova.compute.claims [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Claim successful on node user
Nov 03 13:55:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:55:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.policy [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999849806e0342e2ae95e75b749942e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffcb22b31c948d7a2b7bd1587392f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:55:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Creating image(s)
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk 1073741824" returned: 0 in 0.052s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Successfully created port: da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:55:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Cannot resize image /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Ensure instance console log exists: /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Successfully updated port: da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquired lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-changed-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Refreshing instance network info cache due to event network-changed-da2dc401-86fb-41d5-a28a-00da537e742a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] Acquiring lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Releasing lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Instance network_info: |[{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] Acquired lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:52 user nova-compute[74582]: DEBUG nova.network.neutron [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Refreshing network info cache for port da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Start _get_guest_xml network_info=[{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:55:53 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:53 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.objects.instance [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'pci_devices' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:55:53 user nova-compute[74582]:   <uuid>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</uuid>
Nov 03 13:55:53 user nova-compute[74582]:   <name>instance-00000015</name>
Nov 03 13:55:53 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:55:53 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:55:53 user nova-compute[74582]:   <metadata>
Nov 03 13:55:53 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:55:53 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:55:53 user nova-compute[74582]:       <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:55:53 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:55:53</nova:creationTime>
Nov 03 13:55:53 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:55:53 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:55:53 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:55:53 user nova-compute[74582]:       <nova:owner>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:55:53 user nova-compute[74582]:       </nova:owner>
Nov 03 13:55:53 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:55:53 user nova-compute[74582]:       <nova:ports>
Nov 03 13:55:53 user nova-compute[74582]:         <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:55:53 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:55:53 user nova-compute[74582]:         </nova:port>
Nov 03 13:55:53 user nova-compute[74582]:       </nova:ports>
Nov 03 13:55:53 user nova-compute[74582]:     </nova:instance>
Nov 03 13:55:53 user nova-compute[74582]:   </metadata>
Nov 03 13:55:53 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:55:53 user nova-compute[74582]:     <system>
Nov 03 13:55:53 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:55:53 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:55:53 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:55:53 user nova-compute[74582]:       <entry name="serial">882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:55:53 user nova-compute[74582]:       <entry name="uuid">882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:55:53 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:55:53 user nova-compute[74582]:     </system>
Nov 03 13:55:53 user nova-compute[74582]:   </sysinfo>
Nov 03 13:55:53 user nova-compute[74582]:   <os>
Nov 03 13:55:53 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:55:53 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:55:53 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:55:53 user nova-compute[74582]:   </os>
Nov 03 13:55:53 user nova-compute[74582]:   <features>
Nov 03 13:55:53 user nova-compute[74582]:     <acpi/>
Nov 03 13:55:53 user nova-compute[74582]:     <apic/>
Nov 03 13:55:53 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:55:53 user nova-compute[74582]:   </features>
Nov 03 13:55:53 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:55:53 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:55:53 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:55:53 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:55:53 user nova-compute[74582]:   </clock>
Nov 03 13:55:53 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:55:53 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:55:53 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:55:53 user nova-compute[74582]:   </cpu>
Nov 03 13:55:53 user nova-compute[74582]:   <devices>
Nov 03 13:55:53 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:55:53 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:55:53 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk"/>
Nov 03 13:55:53 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:55:53 user nova-compute[74582]:     </disk>
Nov 03 13:55:53 user nova-compute[74582]:     <disk type="file" device="cdrom">
Nov 03 13:55:53 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 13:55:53 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config"/>
Nov 03 13:55:53 user nova-compute[74582]:       <target dev="hda" bus="ide"/>
Nov 03 13:55:53 user nova-compute[74582]:     </disk>
Nov 03 13:55:53 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:55:53 user nova-compute[74582]:       <mac address="fa:16:3e:66:92:9b"/>
Nov 03 13:55:53 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:53 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:55:53 user nova-compute[74582]:       <target dev="tapda2dc401-86"/>
Nov 03 13:55:53 user nova-compute[74582]:     </interface>
Nov 03 13:55:53 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:55:53 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log" append="off"/>
Nov 03 13:55:53 user nova-compute[74582]:     </serial>
Nov 03 13:55:53 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:55:53 user nova-compute[74582]:     <video>
Nov 03 13:55:53 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:53 user nova-compute[74582]:     </video>
Nov 03 13:55:53 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:55:53 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:55:53 user nova-compute[74582]:     </rng>
Nov 03 13:55:53 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:55:53 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:55:53 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:55:53 user nova-compute[74582]:     </memballoon>
Nov 03 13:55:53 user nova-compute[74582]:   </devices>
Nov 03 13:55:53 user nova-compute[74582]: </domain>
Nov 03 13:55:53 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG os_vif [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1d69d46-be4b-5d7e-bc65-77be94533bd3', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda2dc401-86, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda2dc401-86, col_values=(('qos', UUID('16352969-1160-43d9-8ec9-d75c917db7d6')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda2dc401-86, col_values=(('external_ids', {'iface-id': 'da2dc401-86fb-41d5-a28a-00da537e742a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:92:9b', 'vm-uuid': '882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:53 user nova-compute[74582]: INFO os_vif [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86')
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No BDM found with device name hda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No VIF found with MAC fa:16:3e:66:92:9b, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:55:53 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Using config drive
Nov 03 13:55:53 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Creating config drive at /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6jb3yd7z {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6jb3yd7z" returned: 0 in 0.063s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updated VIF entry in instance network info cache for port da2dc401-86fb-41d5-a28a-00da537e742a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ad3527d7-56f7-4702-b084-58922ecf04e0 req-2bf10970-aa04-4195-b864-afb63d59abe5 service nova] Releasing lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:55:54 user nova-compute[74582]: INFO nova.compute.claims [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Claim successful on node user
Nov 03 13:55:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-d515d2b3-a175-48a4-8ba4-e1f48f117db3 req-3132a7b1-1603-457a-874a-45d4ab3ed5ea service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d515d2b3-a175-48a4-8ba4-e1f48f117db3 req-3132a7b1-1603-457a-874a-45d4ab3ed5ea service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d515d2b3-a175-48a4-8ba4-e1f48f117db3 req-3132a7b1-1603-457a-874a-45d4ab3ed5ea service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d515d2b3-a175-48a4-8ba4-e1f48f117db3 req-3132a7b1-1603-457a-874a-45d4ab3ed5ea service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-d515d2b3-a175-48a4-8ba4-e1f48f117db3 req-3132a7b1-1603-457a-874a-45d4ab3ed5ea service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:54 user nova-compute[74582]: WARNING nova.compute.manager [req-d515d2b3-a175-48a4-8ba4-e1f48f117db3 req-3132a7b1-1603-457a-874a-45d4ab3ed5ea service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a for instance with vm_state building and task_state spawning.
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:55:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.policy [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aff1acfbf504e3ca9fadaf662314da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d23e2540d949c28d9db7cffe3157ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:55:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Creating image(s)
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "/opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "/opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "/opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk 1073741824" returned: 0 in 0.128s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.223s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Successfully created port: 2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Cannot resize image /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Ensure instance console log exists: /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Successfully updated port: 2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebdd9708-0858-4afd-86e7-faa846bc2ead req-853d4336-2a4a-4282-9de9-603ba43e09a1 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebdd9708-0858-4afd-86e7-faa846bc2ead req-853d4336-2a4a-4282-9de9-603ba43e09a1 service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebdd9708-0858-4afd-86e7-faa846bc2ead req-853d4336-2a4a-4282-9de9-603ba43e09a1 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebdd9708-0858-4afd-86e7-faa846bc2ead req-853d4336-2a4a-4282-9de9-603ba43e09a1 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebdd9708-0858-4afd-86e7-faa846bc2ead req-853d4336-2a4a-4282-9de9-603ba43e09a1 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:57 user nova-compute[74582]: WARNING nova.compute.manager [req-ebdd9708-0858-4afd-86e7-faa846bc2ead req-853d4336-2a4a-4282-9de9-603ba43e09a1 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a for instance with vm_state building and task_state spawning.
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquired lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-changed-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Refreshing instance network info cache due to event network-changed-2cc121ca-a5ae-47ba-9fc3-9c32b7360790. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] Acquiring lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:55:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Instance spawned successfully.
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:57 user nova-compute[74582]: INFO nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Releasing lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance network_info: |[{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] Acquired lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Refreshing network info cache for port 2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Start _get_guest_xml network_info=[{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:55:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:55:57 user nova-compute[74582]: INFO nova.compute.manager [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Took 6.90 seconds to build instance.
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-299992870',display_name='tempest-tempest.common.compute-instance-299992870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-299992870',id=22,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtl0xERP3j+KsAcfY+ZXBsjzwz0w8MMe5s3YYcbBiTVdgqCuN3k7PcBhDOTW6Raj3Gplcn4bqG+K0XUXlRBMOWcRa6tyoa9fwqa2+NVqNaGfC3/MqDB2PyInJ7Hc/fcRA==',key_name='tempest-keypair-1466447300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-0yzrsjsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=c872e44a-e815-4f43-bbea-867d7a189c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'pci_devices' on Instance uuid c872e44a-e815-4f43-bbea-867d7a189c2e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1aadb89f-6e2c-4a97-8400-5db86e555d0e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.027s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:55:57 user nova-compute[74582]:   <uuid>c872e44a-e815-4f43-bbea-867d7a189c2e</uuid>
Nov 03 13:55:57 user nova-compute[74582]:   <name>instance-00000016</name>
Nov 03 13:55:57 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:55:57 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:55:57 user nova-compute[74582]:   <metadata>
Nov 03 13:55:57 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:55:57 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:55:57 user nova-compute[74582]:       <nova:name>tempest-tempest.common.compute-instance-299992870</nova:name>
Nov 03 13:55:57 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:55:57</nova:creationTime>
Nov 03 13:55:57 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:55:57 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:55:57 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:55:57 user nova-compute[74582]:       <nova:owner>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:user uuid="1aff1acfbf504e3ca9fadaf662314da0">tempest-ServerActionsTestOtherA-1486248520-project-member</nova:user>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:project uuid="89d23e2540d949c28d9db7cffe3157ac">tempest-ServerActionsTestOtherA-1486248520</nova:project>
Nov 03 13:55:57 user nova-compute[74582]:       </nova:owner>
Nov 03 13:55:57 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:55:57 user nova-compute[74582]:       <nova:ports>
Nov 03 13:55:57 user nova-compute[74582]:         <nova:port uuid="2cc121ca-a5ae-47ba-9fc3-9c32b7360790">
Nov 03 13:55:57 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 13:55:57 user nova-compute[74582]:         </nova:port>
Nov 03 13:55:57 user nova-compute[74582]:       </nova:ports>
Nov 03 13:55:57 user nova-compute[74582]:     </nova:instance>
Nov 03 13:55:57 user nova-compute[74582]:   </metadata>
Nov 03 13:55:57 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:55:57 user nova-compute[74582]:     <system>
Nov 03 13:55:57 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:55:57 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:55:57 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:55:57 user nova-compute[74582]:       <entry name="serial">c872e44a-e815-4f43-bbea-867d7a189c2e</entry>
Nov 03 13:55:57 user nova-compute[74582]:       <entry name="uuid">c872e44a-e815-4f43-bbea-867d7a189c2e</entry>
Nov 03 13:55:57 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:55:57 user nova-compute[74582]:     </system>
Nov 03 13:55:57 user nova-compute[74582]:   </sysinfo>
Nov 03 13:55:57 user nova-compute[74582]:   <os>
Nov 03 13:55:57 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:55:57 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:55:57 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:55:57 user nova-compute[74582]:   </os>
Nov 03 13:55:57 user nova-compute[74582]:   <features>
Nov 03 13:55:57 user nova-compute[74582]:     <acpi/>
Nov 03 13:55:57 user nova-compute[74582]:     <apic/>
Nov 03 13:55:57 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:55:57 user nova-compute[74582]:   </features>
Nov 03 13:55:57 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:55:57 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:55:57 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:55:57 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:55:57 user nova-compute[74582]:   </clock>
Nov 03 13:55:57 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:55:57 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:55:57 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:55:57 user nova-compute[74582]:   </cpu>
Nov 03 13:55:57 user nova-compute[74582]:   <devices>
Nov 03 13:55:57 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:55:57 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:55:57 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk"/>
Nov 03 13:55:57 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:55:57 user nova-compute[74582]:     </disk>
Nov 03 13:55:57 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:55:57 user nova-compute[74582]:       <mac address="fa:16:3e:b9:07:f2"/>
Nov 03 13:55:57 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:57 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:55:57 user nova-compute[74582]:       <target dev="tap2cc121ca-a5"/>
Nov 03 13:55:57 user nova-compute[74582]:     </interface>
Nov 03 13:55:57 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:55:57 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/console.log" append="off"/>
Nov 03 13:55:57 user nova-compute[74582]:     </serial>
Nov 03 13:55:57 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:55:57 user nova-compute[74582]:     <video>
Nov 03 13:55:57 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:55:57 user nova-compute[74582]:     </video>
Nov 03 13:55:57 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:55:57 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:55:57 user nova-compute[74582]:     </rng>
Nov 03 13:55:57 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:55:57 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:55:57 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:55:57 user nova-compute[74582]:     </memballoon>
Nov 03 13:55:57 user nova-compute[74582]:   </devices>
Nov 03 13:55:57 user nova-compute[74582]: </domain>
Nov 03 13:55:57 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-299992870',display_name='tempest-tempest.common.compute-instance-299992870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-299992870',id=22,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtl0xERP3j+KsAcfY+ZXBsjzwz0w8MMe5s3YYcbBiTVdgqCuN3k7PcBhDOTW6Raj3Gplcn4bqG+K0XUXlRBMOWcRa6tyoa9fwqa2+NVqNaGfC3/MqDB2PyInJ7Hc/fcRA==',key_name='tempest-keypair-1466447300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-0yzrsjsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=c872e44a-e815-4f43-bbea-867d7a189c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG os_vif [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95ad2397-02c5-5dae-9879-eb4d896cab98', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cc121ca-a5, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cc121ca-a5, col_values=(('qos', UUID('bbd48cdd-ea03-4381-9409-576987b6dfad')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cc121ca-a5, col_values=(('external_ids', {'iface-id': '2cc121ca-a5ae-47ba-9fc3-9c32b7360790', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:07:f2', 'vm-uuid': 'c872e44a-e815-4f43-bbea-867d7a189c2e'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:57 user nova-compute[74582]: INFO os_vif [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5')
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No VIF found with MAC fa:16:3e:b9:07:f2, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updated VIF entry in instance network info cache for port 2cc121ca-a5ae-47ba-9fc3-9c32b7360790. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b8346e0b-10e1-4ac2-83bd-cc5e16292067 req-d7b76a8e-5a8d-4697-bb38-06bf85901576 service nova] Releasing lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-584d40a1-ba44-4680-ab62-0e4e0fabb019 req-9311feaf-b3e6-44fb-8d87-015606c26298 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-584d40a1-ba44-4680-ab62-0e4e0fabb019 req-9311feaf-b3e6-44fb-8d87-015606c26298 service nova] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-584d40a1-ba44-4680-ab62-0e4e0fabb019 req-9311feaf-b3e6-44fb-8d87-015606c26298 service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-584d40a1-ba44-4680-ab62-0e4e0fabb019 req-9311feaf-b3e6-44fb-8d87-015606c26298 service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-584d40a1-ba44-4680-ab62-0e4e0fabb019 req-9311feaf-b3e6-44fb-8d87-015606c26298 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] No waiting events found dispatching network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:55:59 user nova-compute[74582]: WARNING nova.compute.manager [req-584d40a1-ba44-4680-ab62-0e4e0fabb019 req-9311feaf-b3e6-44fb-8d87-015606c26298 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received unexpected event network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 for instance with vm_state building and task_state spawning.
Nov 03 13:55:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:55:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:00 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:56:00 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.358177185058594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 24e90b05-29db-4dbd-8916-be21cfcc4041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d9bac93a-31ea-411d-868a-0afb4ff56880 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c872e44a-e815-4f43-bbea-867d7a189c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:00 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:56:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance spawned successfully.
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-e8261712-ef19-4dde-b219-a179cce2f0cc req-f9cb1ddf-33e9-4737-892d-67b3a5539813 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e8261712-ef19-4dde-b219-a179cce2f0cc req-f9cb1ddf-33e9-4737-892d-67b3a5539813 service nova] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e8261712-ef19-4dde-b219-a179cce2f0cc req-f9cb1ddf-33e9-4737-892d-67b3a5539813 service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e8261712-ef19-4dde-b219-a179cce2f0cc req-f9cb1ddf-33e9-4737-892d-67b3a5539813 service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-e8261712-ef19-4dde-b219-a179cce2f0cc req-f9cb1ddf-33e9-4737-892d-67b3a5539813 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] No waiting events found dispatching network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:01 user nova-compute[74582]: WARNING nova.compute.manager [req-e8261712-ef19-4dde-b219-a179cce2f0cc req-f9cb1ddf-33e9-4737-892d-67b3a5539813 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received unexpected event network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 for instance with vm_state building and task_state spawning.
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:01 user nova-compute[74582]: INFO nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 03 13:56:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:56:01 user nova-compute[74582]: INFO nova.compute.manager [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Took 6.99 seconds to build instance.
Nov 03 13:56:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-64927d6b-57c8-4ec7-9300-fa52a55fa36b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.084s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-changed-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Refreshing instance network info cache due to event network-changed-13ebd409-8962-428d-9ae8-57dd2613ffc5. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:56:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] Acquiring lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] Acquired lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Refreshing network info cache for port 13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.network.neutron [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updated VIF entry in instance network info cache for port 13ebd409-8962-428d-9ae8-57dd2613ffc5. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.network.neutron [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating instance_info_cache with network_info: [{"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9c4caea9-bbcd-4e46-8a29-1cf75c0d50ee req-5ea9cf24-ffce-4f2b-a7ea-c2a06fe5ae87 service nova] Releasing lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquired lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'info_cache' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Releasing lock "refresh_cache-0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:04 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance destroyed successfully.
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'resources' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG os_vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b20a9c0-1c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d289bf93-3bcb-4d83-bfc3-aee36864f2dc) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:04 user nova-compute[74582]: INFO os_vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c')
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start _get_guest_xml network_info=[{"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'numa_topology' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:04 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:56:04 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'pci_devices' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:56:04 user nova-compute[74582]:   <uuid>0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</uuid>
Nov 03 13:56:04 user nova-compute[74582]:   <name>instance-00000003</name>
Nov 03 13:56:04 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:56:04 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:56:04 user nova-compute[74582]:   <metadata>
Nov 03 13:56:04 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:56:04 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:56:04 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeTestJSON-server-2072902535</nova:name>
Nov 03 13:56:04 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:56:04</nova:creationTime>
Nov 03 13:56:04 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:56:04 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:56:04 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:56:04 user nova-compute[74582]:       <nova:owner>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:user uuid="9ee2e8967900436e874e86e6dd64ce72">tempest-AttachVolumeTestJSON-331837995-project-member</nova:user>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:project uuid="867ccc345ce547daa6a83fe5f13c74b7">tempest-AttachVolumeTestJSON-331837995</nova:project>
Nov 03 13:56:04 user nova-compute[74582]:       </nova:owner>
Nov 03 13:56:04 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:56:04 user nova-compute[74582]:       <nova:ports>
Nov 03 13:56:04 user nova-compute[74582]:         <nova:port uuid="2b20a9c0-1c23-4a40-96fc-722cb901bf56">
Nov 03 13:56:04 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:56:04 user nova-compute[74582]:         </nova:port>
Nov 03 13:56:04 user nova-compute[74582]:       </nova:ports>
Nov 03 13:56:04 user nova-compute[74582]:     </nova:instance>
Nov 03 13:56:04 user nova-compute[74582]:   </metadata>
Nov 03 13:56:04 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:56:04 user nova-compute[74582]:     <system>
Nov 03 13:56:04 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:56:04 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:56:04 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:56:04 user nova-compute[74582]:       <entry name="serial">0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</entry>
Nov 03 13:56:04 user nova-compute[74582]:       <entry name="uuid">0795b1b5-b17d-4cbd-ba36-f8a4de7083c2</entry>
Nov 03 13:56:04 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:56:04 user nova-compute[74582]:     </system>
Nov 03 13:56:04 user nova-compute[74582]:   </sysinfo>
Nov 03 13:56:04 user nova-compute[74582]:   <os>
Nov 03 13:56:04 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:56:04 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:56:04 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:56:04 user nova-compute[74582]:   </os>
Nov 03 13:56:04 user nova-compute[74582]:   <features>
Nov 03 13:56:04 user nova-compute[74582]:     <acpi/>
Nov 03 13:56:04 user nova-compute[74582]:     <apic/>
Nov 03 13:56:04 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:56:04 user nova-compute[74582]:   </features>
Nov 03 13:56:04 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:56:04 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:56:04 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:56:04 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:56:04 user nova-compute[74582]:   </clock>
Nov 03 13:56:04 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:56:04 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:56:04 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:56:04 user nova-compute[74582]:   </cpu>
Nov 03 13:56:04 user nova-compute[74582]:   <devices>
Nov 03 13:56:04 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:56:04 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:56:04 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk"/>
Nov 03 13:56:04 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:56:04 user nova-compute[74582]:     </disk>
Nov 03 13:56:04 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:56:04 user nova-compute[74582]:       <mac address="fa:16:3e:75:8e:a5"/>
Nov 03 13:56:04 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:56:04 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:56:04 user nova-compute[74582]:       <target dev="tap2b20a9c0-1c"/>
Nov 03 13:56:04 user nova-compute[74582]:     </interface>
Nov 03 13:56:04 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:56:04 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/console.log" append="off"/>
Nov 03 13:56:04 user nova-compute[74582]:     </serial>
Nov 03 13:56:04 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:56:04 user nova-compute[74582]:     <video>
Nov 03 13:56:04 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:56:04 user nova-compute[74582]:     </video>
Nov 03 13:56:04 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:56:04 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:56:04 user nova-compute[74582]:     </rng>
Nov 03 13:56:04 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:56:04 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:56:04 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:56:04 user nova-compute[74582]:     </memballoon>
Nov 03 13:56:04 user nova-compute[74582]:   </devices>
Nov 03 13:56:04 user nova-compute[74582]: </domain>
Nov 03 13:56:04 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Cannot resize image /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'migration_context' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.objects.base [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Object Instance<0795b1b5-b17d-4cbd-ba36-f8a4de7083c2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG os_vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f61105e-5a86-5752-b234-3c34893df8ad', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b20a9c0-1c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b20a9c0-1c, col_values=(('qos', UUID('ef24c819-ddbb-4064-a7ef-cd4b53268471')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b20a9c0-1c, col_values=(('external_ids', {'iface-id': '2b20a9c0-1c23-4a40-96fc-722cb901bf56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:8e:a5', 'vm-uuid': '0795b1b5-b17d-4cbd-ba36-f8a4de7083c2'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:05 user nova-compute[74582]: INFO os_vif [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c')
Nov 03 13:56:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-e5efd02a-73a1-4751-ae77-03432ea52c8e req-e3b0a057-a56e-4752-b7a6-75f2f8f1705c service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e5efd02a-73a1-4751-ae77-03432ea52c8e req-e3b0a057-a56e-4752-b7a6-75f2f8f1705c service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e5efd02a-73a1-4751-ae77-03432ea52c8e req-e3b0a057-a56e-4752-b7a6-75f2f8f1705c service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e5efd02a-73a1-4751-ae77-03432ea52c8e req-e3b0a057-a56e-4752-b7a6-75f2f8f1705c service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-e5efd02a-73a1-4751-ae77-03432ea52c8e req-e3b0a057-a56e-4752-b7a6-75f2f8f1705c service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:06 user nova-compute[74582]: WARNING nova.compute.manager [req-e5efd02a-73a1-4751-ae77-03432ea52c8e req-e3b0a057-a56e-4752-b7a6-75f2f8f1705c service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state stopped and task_state powering-on.
Nov 03 13:56:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-3b2d711c-de4e-45cb-b12a-4501a021308d req-a21024cb-44ea-4df6-b87e-ebad1631c0c6 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3b2d711c-de4e-45cb-b12a-4501a021308d req-a21024cb-44ea-4df6-b87e-ebad1631c0c6 service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3b2d711c-de4e-45cb-b12a-4501a021308d req-a21024cb-44ea-4df6-b87e-ebad1631c0c6 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3b2d711c-de4e-45cb-b12a-4501a021308d req-a21024cb-44ea-4df6-b87e-ebad1631c0c6 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-3b2d711c-de4e-45cb-b12a-4501a021308d req-a21024cb-44ea-4df6-b87e-ebad1631c0c6 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:08 user nova-compute[74582]: WARNING nova.compute.manager [req-3b2d711c-de4e-45cb-b12a-4501a021308d req-a21024cb-44ea-4df6-b87e-ebad1631c0c6 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state stopped and task_state powering-on.
Nov 03 13:56:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:56:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance rebooted successfully.
Nov 03 13:56:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e3bf8569-c299-40e3-9594-3dabe415a947 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:09 user nova-compute[74582]: INFO nova.compute.manager [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attaching volume b10ac76c-9087-4d81-9377-1d8cbf001088 to /dev/vdb
Nov 03 13:56:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[035288db-b29c-489e-b1f3-8a01aee7586e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec966c-f85c-456c-966d-9d1169cbef5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d3483e-04e4-4094-8b76-9124fb401837]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[56322761-2474-4ead-b47b-69fc84ab43e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:56:09 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:56:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f66a48-20b1-4b03-be3e-aa491fa2abbd]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:56:09 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating existing volume attachment record: 3f0fc6c5-2ef4-49bf-b065-fc33a1d02cc7 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:56:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:25 user nova-compute[74582]: INFO nova.compute.manager [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Terminating instance
Nov 03 13:56:25 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-6609b1d2-dc62-4c33-897a-503fe090a22c req-5e4da4d6-f714-4d3b-a441-6e2e54b0bbc0 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-vif-unplugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6609b1d2-dc62-4c33-897a-503fe090a22c req-5e4da4d6-f714-4d3b-a441-6e2e54b0bbc0 service nova] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6609b1d2-dc62-4c33-897a-503fe090a22c req-5e4da4d6-f714-4d3b-a441-6e2e54b0bbc0 service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6609b1d2-dc62-4c33-897a-503fe090a22c req-5e4da4d6-f714-4d3b-a441-6e2e54b0bbc0 service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-6609b1d2-dc62-4c33-897a-503fe090a22c req-5e4da4d6-f714-4d3b-a441-6e2e54b0bbc0 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] No waiting events found dispatching network-vif-unplugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-6609b1d2-dc62-4c33-897a-503fe090a22c req-5e4da4d6-f714-4d3b-a441-6e2e54b0bbc0 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-vif-unplugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:56:26 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Instance destroyed successfully.
Nov 03 13:56:26 user nova-compute[74582]: DEBUG nova.objects.instance [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lazy-loading 'resources' on Instance uuid 59ca7381-f253-4009-8c29-f43ed1b335a3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-139702557',display_name='tempest-ServersNegativeTestJSON-server-139702557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-139702557',id=2,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1625c2271dab47af9751af0bb23fcd64',ramdisk_id='',reservation_id='r-1ar1p1s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-147568106',owner_user_name='tempest-ServersNegativeTestJSON-147568106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:47:37Z,user_data=None,user_id='2790fcec7e2e4ad0b653e5d45c98372e',uuid=59ca7381-f253-4009-8c29-f43ed1b335a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converting VIF {"id": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "address": "fa:16:3e:59:b4:cd", "network": {"id": "339509f4-e31c-4e5e-8103-e7da336d840e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1907895502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1625c2271dab47af9751af0bb23fcd64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3fd6c-12", "ovs_interfaceid": "6bc3fd6c-127e-4a84-8ba8-89c25c66543e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG os_vif [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bc3fd6c-12, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cad3add3-e85a-4ed6-8550-18644722eb56) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:26 user nova-compute[74582]: INFO os_vif [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b4:cd,bridge_name='br-int',has_traffic_filtering=True,id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e,network=Network(339509f4-e31c-4e5e-8103-e7da336d840e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3fd6c-12')
Nov 03 13:56:26 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Deleting instance files /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3_del
Nov 03 13:56:26 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Deletion of /opt/stack/data/nova/instances/59ca7381-f253-4009-8c29-f43ed1b335a3_del complete
Nov 03 13:56:26 user nova-compute[74582]: INFO nova.compute.manager [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 03 13:56:26 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:56:26 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-396f23f5-80ed-4c1c-9139-09e6de897fb9 req-43a06e6b-e9b9-476e-844a-0562ba71ce17 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-vif-deleted-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:27 user nova-compute[74582]: INFO nova.compute.manager [req-396f23f5-80ed-4c1c-9139-09e6de897fb9 req-43a06e6b-e9b9-476e-844a-0562ba71ce17 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Neutron deleted interface 6bc3fd6c-127e-4a84-8ba8-89c25c66543e; detaching it from the instance and deleting it from the info cache
Nov 03 13:56:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-396f23f5-80ed-4c1c-9139-09e6de897fb9 req-43a06e6b-e9b9-476e-844a-0562ba71ce17 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:27 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Took 0.51 seconds to deallocate network for instance.
Nov 03 13:56:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-396f23f5-80ed-4c1c-9139-09e6de897fb9 req-43a06e6b-e9b9-476e-844a-0562ba71ce17 service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Detach interface failed, port_id=6bc3fd6c-127e-4a84-8ba8-89c25c66543e, reason: Instance 59ca7381-f253-4009-8c29-f43ed1b335a3 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:56:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:27 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Deleted allocations for instance 59ca7381-f253-4009-8c29-f43ed1b335a3
Nov 03 13:56:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2b5c9fe4-bc5d-4996-9ba7-ee85a1ff28f1 tempest-ServersNegativeTestJSON-147568106 tempest-ServersNegativeTestJSON-147568106-project-member] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received event network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] Acquiring lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] Lock "59ca7381-f253-4009-8c29-f43ed1b335a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] No waiting events found dispatching network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:28 user nova-compute[74582]: WARNING nova.compute.manager [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 59ca7381-f253-4009-8c29-f43ed1b335a3] Received unexpected event network-vif-plugged-6bc3fd6c-127e-4a84-8ba8-89c25c66543e for instance with vm_state deleted and task_state None.
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-changed-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Refreshing instance network info cache due to event network-changed-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] Acquiring lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] Acquired lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Refreshing network info cache for port 7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updated VIF entry in instance network info cache for port 7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updating instance_info_cache with network_info: [{"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e67c65d9-edb8-4e01-b262-949a1d2d6311 req-34e90427-9198-4043-b83f-c6bd40ef7a8a service nova] Releasing lock "refresh_cache-24e90b05-29db-4dbd-8916-be21cfcc4041" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJYOIlmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:56:31 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:56:31 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:56:31 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3535522c-c8e1-40c1-924b-5920c0aebb6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:56:31 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5357c2ea-f112-46e4-9ede-f3e1e2f546af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088] added
Nov 03 13:56:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1ee6fa-7734-49f5-a95a-5c538404e225]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66ec3c6-3a16-4549-908a-f96a2d0a8074]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJYOIlmt {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJYOIlmt" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[935a3726-9c5e-4d44-b436-e021263081f6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJYOIlmt'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f5c783-0419-4fef-b0f2-2341a06f54b4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dc6d09-99d1-4088-8cd8-b6cf93369aaa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bdcdc5-59c0-4409-8303-2a413a5f1dc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260]
Nov 03 13:56:31 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260] successful.
Nov 03 13:56:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e4b138-52f1-4416-a3bc-7138895b356e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef55533-9df2-4b80-bd68-6bbb6a604fdc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:31 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:56:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:31 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:56:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f1ef58-4cb7-4919-a7dc-cb140ef674c8]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:56:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJYOIlmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23639653466346433', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639653466346433', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG nova.objects.instance [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:56:32 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:56:32 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:56:32 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:56:32 user nova-compute[74582]:   <serial>b10ac76c-9087-4d81-9377-1d8cbf001088</serial>
Nov 03 13:56:32 user nova-compute[74582]: </disk>
Nov 03 13:56:32 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:56:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No VIF found with MAC fa:16:3e:40:c0:b6, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-772f36e2-178e-469b-8520-c7ea5bd29477 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.355s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid 24e90b05-29db-4dbd-8916-be21cfcc4041 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:33 user nova-compute[74582]: INFO nova.compute.manager [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Attaching volume d6ffbc34-59ea-46da-9bff-7d499158132a to /dev/vdb
Nov 03 13:56:33 user nova-compute[74582]: DEBUG os_brick.utils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a911d1d-4889-49ac-8817-d925e5d2ff70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a153a8-668d-4dd3-b3ab-136d13d88e80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37acc6c7-3440-4d77-a09e-74a54e9b2fe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b6095c-e6fc-473a-98c0-4e5c32948abb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:56:34 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:56:34 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030391a-e515-4bfe-bee4-52d27400e268]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG os_brick.utils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:56:34 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updating existing volume attachment record: f4979dfc-efe4-4cdf-b759-0dcdd8d91434 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:56:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing instance network info cache due to event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:56:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:38 user nova-compute[74582]: DEBUG nova.network.neutron [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:56:39 user nova-compute[74582]: DEBUG nova.network.neutron [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updated VIF entry in instance network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:56:39 user nova-compute[74582]: DEBUG nova.network.neutron [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8712a9e6-8e6e-4e11-be62-79371de31093 req-b253e967-9e97-457b-acd6-4c217660e347 service nova] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "66414a19-4a63-4621-82f2-33d5c60769cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:40 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:56:40 user nova-compute[74582]: INFO nova.compute.claims [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Claim successful on node user
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:56:41 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:56:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.policy [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e900eb8f4f6548f183010bc08a3c66f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc44a2fb46b4a649544d7e506a2d96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:56:41 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Creating image(s)
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "/opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.313s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Successfully created port: 89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk 1073741824" returned: 0 in 0.049s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Cannot resize image /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Ensure instance console log exists: /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Successfully updated port: 89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-changed-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Refreshing instance network info cache due to event network-changed-89c47875-db7c-4b43-835c-82499860921a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] Acquiring lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.neutron [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Updating instance_info_cache with network_info: [{"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Instance network_info: |[{"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] Acquired lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.neutron [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Refreshing network info cache for port 89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Start _get_guest_xml network_info=[{"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:56:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:56:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1748059274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1748059274',id=23,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-0wa883fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:56:42Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=66414a19-4a63-4621-82f2-33d5c60769cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'pci_devices' on Instance uuid 66414a19-4a63-4621-82f2-33d5c60769cc {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:56:43 user nova-compute[74582]:   <uuid>66414a19-4a63-4621-82f2-33d5c60769cc</uuid>
Nov 03 13:56:43 user nova-compute[74582]:   <name>instance-00000017</name>
Nov 03 13:56:43 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:56:43 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:56:43 user nova-compute[74582]:   <metadata>
Nov 03 13:56:43 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:56:43 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:56:43 user nova-compute[74582]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1748059274</nova:name>
Nov 03 13:56:43 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:56:43</nova:creationTime>
Nov 03 13:56:43 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:56:43 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:56:43 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:56:43 user nova-compute[74582]:       <nova:owner>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:user uuid="e900eb8f4f6548f183010bc08a3c66f4">tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member</nova:user>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:project uuid="7bc44a2fb46b4a649544d7e506a2d96b">tempest-ServerBootFromVolumeStableRescueTest-412298968</nova:project>
Nov 03 13:56:43 user nova-compute[74582]:       </nova:owner>
Nov 03 13:56:43 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:56:43 user nova-compute[74582]:       <nova:ports>
Nov 03 13:56:43 user nova-compute[74582]:         <nova:port uuid="89c47875-db7c-4b43-835c-82499860921a">
Nov 03 13:56:43 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 13:56:43 user nova-compute[74582]:         </nova:port>
Nov 03 13:56:43 user nova-compute[74582]:       </nova:ports>
Nov 03 13:56:43 user nova-compute[74582]:     </nova:instance>
Nov 03 13:56:43 user nova-compute[74582]:   </metadata>
Nov 03 13:56:43 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:56:43 user nova-compute[74582]:     <system>
Nov 03 13:56:43 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:56:43 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:56:43 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:56:43 user nova-compute[74582]:       <entry name="serial">66414a19-4a63-4621-82f2-33d5c60769cc</entry>
Nov 03 13:56:43 user nova-compute[74582]:       <entry name="uuid">66414a19-4a63-4621-82f2-33d5c60769cc</entry>
Nov 03 13:56:43 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:56:43 user nova-compute[74582]:     </system>
Nov 03 13:56:43 user nova-compute[74582]:   </sysinfo>
Nov 03 13:56:43 user nova-compute[74582]:   <os>
Nov 03 13:56:43 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:56:43 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:56:43 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:56:43 user nova-compute[74582]:   </os>
Nov 03 13:56:43 user nova-compute[74582]:   <features>
Nov 03 13:56:43 user nova-compute[74582]:     <acpi/>
Nov 03 13:56:43 user nova-compute[74582]:     <apic/>
Nov 03 13:56:43 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:56:43 user nova-compute[74582]:   </features>
Nov 03 13:56:43 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:56:43 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:56:43 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:56:43 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:56:43 user nova-compute[74582]:   </clock>
Nov 03 13:56:43 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:56:43 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:56:43 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:56:43 user nova-compute[74582]:   </cpu>
Nov 03 13:56:43 user nova-compute[74582]:   <devices>
Nov 03 13:56:43 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:56:43 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:56:43 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk"/>
Nov 03 13:56:43 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:56:43 user nova-compute[74582]:     </disk>
Nov 03 13:56:43 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:56:43 user nova-compute[74582]:       <mac address="fa:16:3e:8f:97:ac"/>
Nov 03 13:56:43 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:56:43 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:56:43 user nova-compute[74582]:       <target dev="tap89c47875-db"/>
Nov 03 13:56:43 user nova-compute[74582]:     </interface>
Nov 03 13:56:43 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:56:43 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/console.log" append="off"/>
Nov 03 13:56:43 user nova-compute[74582]:     </serial>
Nov 03 13:56:43 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:56:43 user nova-compute[74582]:     <video>
Nov 03 13:56:43 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:56:43 user nova-compute[74582]:     </video>
Nov 03 13:56:43 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:56:43 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:56:43 user nova-compute[74582]:     </rng>
Nov 03 13:56:43 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:56:43 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:56:43 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:56:43 user nova-compute[74582]:     </memballoon>
Nov 03 13:56:43 user nova-compute[74582]:   </devices>
Nov 03 13:56:43 user nova-compute[74582]: </domain>
Nov 03 13:56:43 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1748059274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1748059274',id=23,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-0wa883fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:56:42Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=66414a19-4a63-4621-82f2-33d5c60769cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG os_vif [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd27d999e-af8e-54ae-8fae-1cea978fa769', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89c47875-db, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89c47875-db, col_values=(('qos', UUID('30c719d2-bf7b-481a-923c-af49245ce661')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89c47875-db, col_values=(('external_ids', {'iface-id': '89c47875-db7c-4b43-835c-82499860921a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:97:ac', 'vm-uuid': '66414a19-4a63-4621-82f2-33d5c60769cc'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:43 user nova-compute[74582]: INFO os_vif [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db')
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No VIF found with MAC fa:16:3e:8f:97:ac, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.neutron [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Updated VIF entry in instance network info cache for port 89c47875-db7c-4b43-835c-82499860921a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG nova.network.neutron [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Updating instance_info_cache with network_info: [{"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2109f11b-f456-4d7a-a0f0-3a43a36fc898 req-ea673952-25fc-4c26-8ebb-742a594bf559 service nova] Releasing lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-e2664b06-80f8-4331-89b4-640f2430a3bb req-400b7ef6-c896-48e0-b434-397b501dc587 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e2664b06-80f8-4331-89b4-640f2430a3bb req-400b7ef6-c896-48e0-b434-397b501dc587 service nova] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e2664b06-80f8-4331-89b4-640f2430a3bb req-400b7ef6-c896-48e0-b434-397b501dc587 service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e2664b06-80f8-4331-89b4-640f2430a3bb req-400b7ef6-c896-48e0-b434-397b501dc587 service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-e2664b06-80f8-4331-89b4-640f2430a3bb req-400b7ef6-c896-48e0-b434-397b501dc587 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] No waiting events found dispatching network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:44 user nova-compute[74582]: WARNING nova.compute.manager [req-e2664b06-80f8-4331-89b4-640f2430a3bb req-400b7ef6-c896-48e0-b434-397b501dc587 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received unexpected event network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a for instance with vm_state building and task_state spawning.
Nov 03 13:56:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:56:46 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Instance spawned successfully.
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-47e92a03-ecac-4295-91ff-c44d8c2e50a1 req-76db7cdd-ea97-47b7-b2d4-14168129cd5c service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-47e92a03-ecac-4295-91ff-c44d8c2e50a1 req-76db7cdd-ea97-47b7-b2d4-14168129cd5c service nova] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-47e92a03-ecac-4295-91ff-c44d8c2e50a1 req-76db7cdd-ea97-47b7-b2d4-14168129cd5c service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-47e92a03-ecac-4295-91ff-c44d8c2e50a1 req-76db7cdd-ea97-47b7-b2d4-14168129cd5c service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-47e92a03-ecac-4295-91ff-c44d8c2e50a1 req-76db7cdd-ea97-47b7-b2d4-14168129cd5c service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] No waiting events found dispatching network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:46 user nova-compute[74582]: WARNING nova.compute.manager [req-47e92a03-ecac-4295-91ff-c44d8c2e50a1 req-76db7cdd-ea97-47b7-b2d4-14168129cd5c service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received unexpected event network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a for instance with vm_state building and task_state spawning.
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:56:47 user nova-compute[74582]: INFO nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 03 13:56:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:56:47 user nova-compute[74582]: INFO nova.compute.manager [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Took 6.24 seconds to build instance.
Nov 03 13:56:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-55f2da16-c0c1-4942-a0e7-e80ddf7a1e4e tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "66414a19-4a63-4621-82f2-33d5c60769cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.327s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:52 user nova-compute[74582]: INFO nova.compute.manager [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Shelving
Nov 03 13:56:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-247df442-471f-44c6-ba35-ec64af1cb5ff req-ed6d3d7d-5216-4445-86ce-7081f7d7cafe service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-unplugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-247df442-471f-44c6-ba35-ec64af1cb5ff req-ed6d3d7d-5216-4445-86ce-7081f7d7cafe service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-247df442-471f-44c6-ba35-ec64af1cb5ff req-ed6d3d7d-5216-4445-86ce-7081f7d7cafe service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-247df442-471f-44c6-ba35-ec64af1cb5ff req-ed6d3d7d-5216-4445-86ce-7081f7d7cafe service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-247df442-471f-44c6-ba35-ec64af1cb5ff req-ed6d3d7d-5216-4445-86ce-7081f7d7cafe service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-unplugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:52 user nova-compute[74582]: WARNING nova.compute.manager [req-247df442-471f-44c6-ba35-ec64af1cb5ff req-ed6d3d7d-5216-4445-86ce-7081f7d7cafe service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-unplugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state active and task_state shelving.
Nov 03 13:56:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance destroyed successfully.
Nov 03 13:56:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Beginning cold snapshot process
Nov 03 13:56:53 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:56:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk /opt/stack/data/nova/instances/snapshots/tmp1z3lwx67/fd84a6bdd1524202b77ee435a20c37dd {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk /opt/stack/data/nova/instances/snapshots/tmp1z3lwx67/fd84a6bdd1524202b77ee435a20c37dd" returned: 0 in 0.946s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:54 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Snapshot extracted, beginning image upload
Nov 03 13:56:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-f6974aa7-8dba-4215-a9fc-37dcfca9795a req-34aa24c0-774a-4056-9a04-763dda636161 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f6974aa7-8dba-4215-a9fc-37dcfca9795a req-34aa24c0-774a-4056-9a04-763dda636161 service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f6974aa7-8dba-4215-a9fc-37dcfca9795a req-34aa24c0-774a-4056-9a04-763dda636161 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f6974aa7-8dba-4215-a9fc-37dcfca9795a req-34aa24c0-774a-4056-9a04-763dda636161 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-f6974aa7-8dba-4215-a9fc-37dcfca9795a req-34aa24c0-774a-4056-9a04-763dda636161 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:56:54 user nova-compute[74582]: WARNING nova.compute.manager [req-f6974aa7-8dba-4215-a9fc-37dcfca9795a req-34aa24c0-774a-4056-9a04-763dda636161 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 13:56:54 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoxqzipV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:56:55 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:56:55 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:56:55 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[155bdacc-8c07-4a72-9763-39ab92caecc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:56:55 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a6a29-eedb-44bd-9e00-a6e6b3544bae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a] added
Nov 03 13:56:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada02b3a-a7ff-48eb-8d13-bc2199ef2d31]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab317b4-8820-4c39-a6d1-330c680e9c4b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoxqzipV {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoxqzipV" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7defbf4-4fa1-4f06-bdc1-c0197a93b51d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LoxqzipV'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3af427-df91-4916-b017-1d075bb74759]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[77680a48-6297-4bd6-89bd-583cb5d08773]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1834ea26-e8fd-4572-982d-75b2680425bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260]
Nov 03 13:56:55 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260] successful.
Nov 03 13:56:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d93df9-ee82-40ab-97dc-59ef8375af5c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9729a220-7657-41b8-b2ec-ec6d14990416]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a (non-flash)
Nov 03 13:56:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:56:55 user nova-compute[74582]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a (non-flash)
Nov 03 13:56:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.045s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d8e99-c7ef-4751-a916-82a797ad354e]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:56:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoxqzipV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23466646262636661', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466646262636661', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG nova.objects.instance [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid 24e90b05-29db-4dbd-8916-be21cfcc4041 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:56:56 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:56:56 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:56:56 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:56:56 user nova-compute[74582]:   <serial>d6ffbc34-59ea-46da-9bff-7d499158132a</serial>
Nov 03 13:56:56 user nova-compute[74582]: </disk>
Nov 03 13:56:56 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:d1:66:2f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Snapshot image upload complete
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-559e6e31-41b8-4c2d-a9b6-266f2c8fc870 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.349s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:57 user nova-compute[74582]: INFO nova.compute.manager [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Shelve offloading
Nov 03 13:56:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance destroyed successfully.
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.compute.manager [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Detaching volume d6ffbc34-59ea-46da-9bff-7d499158132a
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.virt.block_device [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Attempting to driver detach volume d6ffbc34-59ea-46da-9bff-7d499158132a from mountpoint /dev/vdb
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Attempting to detach device vdb from instance 24e90b05-29db-4dbd-8916-be21cfcc4041 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:56:58 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:56:58 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:56:58 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:56:58 user nova-compute[74582]:   <serial>d6ffbc34-59ea-46da-9bff-7d499158132a</serial>
Nov 03 13:56:58 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:56:58 user nova-compute[74582]: </disk>
Nov 03 13:56:58 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully detached device vdb from instance 24e90b05-29db-4dbd-8916-be21cfcc4041 from the persistent domain config.
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24e90b05-29db-4dbd-8916-be21cfcc4041 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:56:58 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:56:58 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:56:58 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:56:58 user nova-compute[74582]:   <serial>d6ffbc34-59ea-46da-9bff-7d499158132a</serial>
Nov 03 13:56:58 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:56:58 user nova-compute[74582]: </disk>
Nov 03 13:56:58 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing instance network info cache due to event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.network.neutron [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance destroyed successfully.
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'resources' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-502419754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-502419754',id=18,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbwD9gJs2yXcQqIFtwatq0hM5ER3YUvbIs0UFXyxEDym93nkGFlja9k2K82n/AvThRa46w8f06lOrGscGtpT3OwMB0tPSvkAtB+MdezDAYpTMxZCeZQS5gruMqCIHf9bQ==',key_name='tempest-keypair-954096694',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:54:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-2b67zupc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member',shelved_at='2023-11-03T13:56:57.205394',shelved_host='user',shelved_image_id='85f70b5b-faad-4b17-96ec-5febee7aca7e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:56:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=d9bac93a-31ea-411d-868a-0afb4ff56880,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG os_vif [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2e2cdf8-b6, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c0abed1-e754-4cda-8cbd-68db078150a2) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:56:58 user nova-compute[74582]: INFO os_vif [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6')
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Deleting instance files /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880_del
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Deletion of /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880_del complete
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:58 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Deleted allocations for instance d9bac93a-31ea-411d-868a-0afb4ff56880
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24e90b05-29db-4dbd-8916-be21cfcc4041 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'numa_topology' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG nova.objects.base [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<d9bac93a-31ea-411d-868a-0afb4ff56880> lazy-loaded attributes: resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updated VIF entry in instance network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fae9b702-a98b-4dad-ac06-0b14ca37587f req-40142ca1-ebc4-4616-9feb-05e75998df27 service nova] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.683s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7c7dada0-a411-48a4-8061-1e1317bfa365 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.296s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:56:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:00 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:57:00 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.25818634033203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 01985e3c-5b20-4701-99c7-d374f5a2d76d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 24e90b05-29db-4dbd-8916-be21cfcc4041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c872e44a-e815-4f43-bbea-867d7a189c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:57:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:57:01 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:57:01 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:57:01 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:57:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-changed-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Refreshing instance network info cache due to event network-changed-22fd01bb-5579-4223-bd50-d9b77f11f886. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] Acquiring lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] Acquired lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG nova.network.neutron [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Refreshing network info cache for port 22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG nova.network.neutron [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updated VIF entry in instance network info cache for port 22fd01bb-5579-4223-bd50-d9b77f11f886. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG nova.network.neutron [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updating instance_info_cache with network_info: [{"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-227a6e41-84fe-4354-9ec6-d57501b81477 req-b005288a-41f6-46b7-928d-234afb662dc3 service nova] Releasing lock "refresh_cache-5f2c5d0f-68d6-43b6-803f-6273a2797147" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'flavor' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:09 user nova-compute[74582]: INFO nova.compute.manager [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attaching volume 96feec6f-41a4-4f3f-915e-ebe6aed52df6 to /dev/vdb
Nov 03 13:57:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f5e00-f03f-4e00-8a4f-b3f258e09725]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4019c2-1074-408c-abb3-b4219f155209]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a9555-04cb-467f-97b6-bb414db50103]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935aebe-66af-4b9d-b18d-57be4cb2a6f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:09 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:57:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03bb721-c416-4a61-9c39-d70181500018]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:09 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updating existing volume attachment record: 8b5b923f-e0d0-4980-afa9-166c1d82e105 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:57:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:12 user nova-compute[74582]: INFO nova.compute.manager [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Detaching volume b10ac76c-9087-4d81-9377-1d8cbf001088
Nov 03 13:57:12 user nova-compute[74582]: INFO nova.virt.block_device [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attempting to driver detach volume b10ac76c-9087-4d81-9377-1d8cbf001088 from mountpoint /dev/vdb
Nov 03 13:57:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Attempting to detach device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:57:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:57:12 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:57:12 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:57:12 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:57:12 user nova-compute[74582]:   <serial>b10ac76c-9087-4d81-9377-1d8cbf001088</serial>
Nov 03 13:57:12 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:57:12 user nova-compute[74582]: </disk>
Nov 03 13:57:12 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:57:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config.
Nov 03 13:57:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:57:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:57:12 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:57:12 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:57:12 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:57:12 user nova-compute[74582]:   <serial>b10ac76c-9087-4d81-9377-1d8cbf001088</serial>
Nov 03 13:57:12 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:57:12 user nova-compute[74582]: </disk>
Nov 03 13:57:12 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:57:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:57:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:18 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24e90b05-29db-4dbd-8916-be21cfcc4041 is timed out.
Nov 03 13:57:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully detached device vdb from instance 24e90b05-29db-4dbd-8916-be21cfcc4041 from the live domain config.
Nov 03 13:57:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoxqzipV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:18 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ed9521-f05e-4431-9e18-824372ee1ca7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:57:18 user nova-compute[74582]: No targets found.
Nov 03 13:57:18 user nova-compute[74582]: iSNS:
Nov 03 13:57:18 user nova-compute[74582]: No targets found.
Nov 03 13:57:18 user nova-compute[74582]: STATIC:
Nov 03 13:57:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088
Nov 03 13:57:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a
Nov 03 13:57:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:57:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:18 user nova-compute[74582]: FIRMWARE:
Nov 03 13:57:18 user nova-compute[74582]: No targets found.
Nov 03 13:57:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:57:18 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:57:18 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b51c4c-14f8-4a10-9877-7bd0bd80b2a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f55350-d269-41bd-814a-3fb913cbe965]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:18 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:18 user nova-compute[74582]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a (non-flash)
Nov 03 13:57:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:18 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:18 user nova-compute[74582]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a (non-flash)
Nov 03 13:57:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f681556c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf9342a-ab6a-480e-a960-9d3e266b5983]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd6ae7d-7ba6-40e8-9f58-cd8329e89667]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[456f43c8-f42f-4877-bb4f-c52e2d9e35cd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae79f766-efe3-4ed4-81a5-90f46edf38bb]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb668fda-2e46-44a0-9999-d724bde64aa7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --logout" returned: 0 in 0.137s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5cc634-5b23-4f96-b3e8-df2962f09ace]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260]
Nov 03 13:57:19 user nova-compute[74582]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a, portal: 172.16.0.220,3260] successful.
Nov 03 13:57:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ffbc34-59ea-46da-9bff-7d499158132a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b558873-926c-409a-afec-ff1f2e2bc44b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== disconnect_volume: return (384ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:57:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid 24e90b05-29db-4dbd-8916-be21cfcc4041 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3de55934-be0b-4e3b-b73c-876207b78fb1 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lazy-loading 'flavor' on Instance uuid 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:22 user nova-compute[74582]: INFO nova.compute.manager [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Attaching volume a1860258-04de-41ea-a0c0-2486c1be0d07 to /dev/vdb
Nov 03 13:57:22 user nova-compute[74582]: DEBUG os_brick.utils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8922d43-2beb-4074-a8a4-0f6acc3bda4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3996ae1a-8d25-4ae2-8b05-70d80ec05a48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc5d12d-d271-4534-944f-0a060c4192e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[042616a5-e211-4daf-89dc-c77f9355cbe1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:22 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:57:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d93538b-4a52-4063-aec0-797f18a1e7f9]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG os_brick.utils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:22 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Updating existing volume attachment record: 48e6399d-dc94-4e53-9584-19b46c846302 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:57:22 user nova-compute[74582]: INFO nova.compute.manager [None req-3b085c1c-5d29-4d2d-85e1-3b4575b38246 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Get console output
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:23 user nova-compute[74582]: INFO nova.compute.manager [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Terminating instance
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] During wait destroy, instance disappeared. {{(pid=74582) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 03 13:57:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Instance destroyed successfully.
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lazy-loading 'resources' on Instance uuid 01985e3c-5b20-4701-99c7-d374f5a2d76d {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-372437466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-241734421',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0Z3EAdEMgKPBJmHJky1vcmcINe+C3ixOHfIGjUzaCZAJW6x21cpktz5sjhOxSWyL0+kP774Jlq+c74EGE/G/pLJyvCvugq+X8qBcYiboqtZNXzbto+ZRWAVuUbWiBBtg==',key_name='tempest-keypair-1401802885',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='6108f707190e46d7808a7c5ac5b1c2bf',ramdisk_id='',reservation_id='r-6ncqv720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1647953654',owner_user_name='tempest-ServerActionsV293TestJSON-1647953654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='337fa0f2b5964789a76d2663c9f73f1c',uuid=01985e3c-5b20-4701-99c7-d374f5a2d76d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converting VIF {"id": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "address": "fa:16:3e:28:5d:1f", "network": {"id": "6135f832-c4ca-40dd-aa45-10b25303bb43", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159248703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6108f707190e46d7808a7c5ac5b1c2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe0296-b0", "ovs_interfaceid": "ecbe0296-b0a8-497a-b256-3540a095f4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_vif [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecbe0296-b0, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:57:23 user nova-compute[74582]: INFO os_vif [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=ecbe0296-b0a8-497a-b256-3540a095f4a0,network=Network(6135f832-c4ca-40dd-aa45-10b25303bb43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe0296-b0')
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDwhiMCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:23 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6f512-d348-45f8-a3c1-96f5dc79181b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:57:23 user nova-compute[74582]: No targets found.
Nov 03 13:57:23 user nova-compute[74582]: iSNS:
Nov 03 13:57:23 user nova-compute[74582]: No targets found.
Nov 03 13:57:23 user nova-compute[74582]: STATIC:
Nov 03 13:57:23 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088
Nov 03 13:57:23 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:23 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:23 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:57:23 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:23 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:23 user nova-compute[74582]: FIRMWARE:
Nov 03 13:57:23 user nova-compute[74582]: No targets found.
Nov 03 13:57:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:57:23 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:57:23 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97f5eb24-2bbe-41ee-afaf-2181e957bd36', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[616325d7-7c26-4ef1-84a2-aaec1314b39c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1841fefa-5311-411f-8d3e-c8a9797400ec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:23 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:23 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f681571c0>, {}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Disconnecting from: [] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] <== disconnect_volume: return (73ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:57:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Deletion of /opt/stack/data/nova/instances/01985e3c-5b20-4701-99c7-d374f5a2d76d_del complete
Nov 03 13:57:23 user nova-compute[74582]: INFO nova.compute.manager [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Took 0.17 seconds to destroy the instance on the hypervisor.
Nov 03 13:57:23 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:57:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:24 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:24 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Took 0.76 seconds to deallocate network for instance.
Nov 03 13:57:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-a63cfa4f-af75-4a69-aa86-14614f51b52b req-40bf234d-356c-4777-baea-3d975c989d29 service nova] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Received event network-vif-deleted-ecbe0296-b0a8-497a-b256-3540a095f4a0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:24 user nova-compute[74582]: INFO nova.compute.manager [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Took 0.08 seconds to detach 1 volumes for instance.
Nov 03 13:57:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] [instance: 01985e3c-5b20-4701-99c7-d374f5a2d76d] Deleting volume: 97f5eb24-2bbe-41ee-afaf-2181e957bd36 {{(pid=74582) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 13:57:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:24 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:57:24 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:57:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:24 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Deleted allocations for instance 01985e3c-5b20-4701-99c7-d374f5a2d76d
Nov 03 13:57:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-418cc895-b31e-4eb8-86fa-b4faacd6c644 tempest-ServerActionsV293TestJSON-1647953654 tempest-ServerActionsV293TestJSON-1647953654-project-member] Lock "01985e3c-5b20-4701-99c7-d374f5a2d76d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuTUiHYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:29 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:29 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:29 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4313cd71-fba8-467a-ac47-842bb5c689a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:57:29 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aac262-bb00-4987-a93b-860bc3fc5460]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6] added
Nov 03 13:57:29 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df65b82-3877-43bc-a4a2-1ba0af3869b1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3933450e-07e6-4073-a4d1-d69dd0894ba1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuTUiHYO {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuTUiHYO" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd437a-f181-4ef0-999b-5bf9701d1ff5]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WuTUiHYO'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dcb12c-5e04-4af6-ba9c-784c0a654b2f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125f720-b89b-4964-bd7f-524829d6a906]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5a680-8c7c-43a5-a875-0a45dbfe7165]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260]
Nov 03 13:57:30 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260] successful.
Nov 03 13:57:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[423bae36-515d-4bb1-91ef-ee5886ee3bae]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d18e9d-454e-45df-acd6-1b1a08e214a0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4a3f9-ffa7-4a9c-bb9d-429d0a45ddb9]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:57:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuTUiHYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23336353666623036', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336353666623036', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'flavor' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:57:31 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:57:31 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:57:31 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:57:31 user nova-compute[74582]:   <serial>96feec6f-41a4-4f3f-915e-ebe6aed52df6</serial>
Nov 03 13:57:31 user nova-compute[74582]: </disk>
Nov 03 13:57:31 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No VIF found with MAC fa:16:3e:08:d4:84, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:57:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7040ffe3-1ed4-409a-9116-5f3e36997d3d tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.808s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:33 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 is timed out.
Nov 03 13:57:33 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config.
Nov 03 13:57:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJYOIlmt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:33 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a116d3-1cbf-4b38-8aec-6c43339a4f26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:57:33 user nova-compute[74582]: No targets found.
Nov 03 13:57:33 user nova-compute[74582]: iSNS:
Nov 03 13:57:33 user nova-compute[74582]: No targets found.
Nov 03 13:57:33 user nova-compute[74582]: STATIC:
Nov 03 13:57:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088
Nov 03 13:57:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:57:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:57:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:33 user nova-compute[74582]: FIRMWARE:
Nov 03 13:57:33 user nova-compute[74582]: No targets found.
Nov 03 13:57:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:57:33 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:57:33 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0d27a-1729-4cd9-8cfb-50e55fc010b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ec224-f699-408f-a68e-c9dc44aa001f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:33 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:33 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:33 user nova-compute[74582]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 (non-flash)
Nov 03 13:57:33 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f88d1af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9783783-ebbe-4e71-b23f-41beb27008c3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e911631b-4d3e-4cbf-bab4-cdaa37e03a02]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e586cc7-ef4b-45f9-8789-4f5f48ece90c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b91f0-bee2-4f71-89d7-3ad85b9c31fa]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[63181391-4e2f-4a7f-95f6-6d59b5d2491c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42064a9a-c27e-4c13-8f43-532fd54f6f61]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260]
Nov 03 13:57:33 user nova-compute[74582]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088, portal: 172.16.0.220,3260] successful.
Nov 03 13:57:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b10ac76c-9087-4d81-9377-1d8cbf001088 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99adfb-14e3-4302-b128-90f50d0469f3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== disconnect_volume: return (321ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:57:34 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b3e1b701-72b6-4164-b7c1-c58e8e4f28af tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.801s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG nova.objects.instance [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'flavor' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:35 user nova-compute[74582]: INFO nova.compute.manager [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attaching volume a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 to /dev/vdc
Nov 03 13:57:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bf24b5-df46-46b9-9c8d-0ac822955bae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8491d5-db03-4e73-ac96-b54b019d5b6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f48204-03d7-48b6-a07e-15bc12ccd620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[995cf43f-12ce-468f-8962-aa66bd668183]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:35 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:57:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[64736537-795e-40bf-aa1e-5981f73ef0dc]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:35 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updating existing volume attachment record: a8fffb6d-9697-4e57-bfca-1bd0c57ac47d {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:57:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:57:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:57:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:57:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:57:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:57:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-changed-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Refreshing instance network info cache due to event network-changed-da2dc401-86fb-41d5-a28a-00da537e742a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:57:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] Acquiring lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:57:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] Acquired lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:57:41 user nova-compute[74582]: DEBUG nova.network.neutron [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Refreshing network info cache for port da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updated VIF entry in instance network info cache for port da2dc401-86fb-41d5-a28a-00da537e742a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9328f635-3f15-433c-a1a3-bebc080aa860 req-f16f513b-18d7-4832-81f2-eb37459267ad service nova] Releasing lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "interface-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "interface-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.objects.instance [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'flavor' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.objects.instance [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'pci_requests' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.objects.base [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Object Instance<882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb> lazy-loaded attributes: flavor,pci_requests {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:57:42 user nova-compute[74582]: DEBUG nova.policy [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999849806e0342e2ae95e75b749942e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffcb22b31c948d7a2b7bd1587392f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG nova.network.neutron [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Successfully created port: ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWuvRypO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:43 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:43 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:43 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a00ca85-dcc2-48f1-bff6-8807b8aad0c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:57:43 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[024497cb-fade-4f52-acf7-77a1f425076f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07] added
Nov 03 13:57:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05e1b79-cda8-41fe-af0e-940c60492990]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8957c3a-5c9c-4df7-b542-b1584cc5fa46]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWuvRypO {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWuvRypO" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b349bc94-a0a1-4d47-a4a2-d3d956d205d7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWuvRypO'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9227c74f-9eac-4218-92e9-e93b6908556e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58f895f-032c-4ef0-88b4-0002a150ae7e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[160847c6-815c-43c6-9790-2cd7dbe78b88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260]
Nov 03 13:57:43 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260] successful.
Nov 03 13:57:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e14d7-81ad-4180-9e66-e4c63e5f389a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c22b0-4788-4797-8491-eb27fcd8e0de]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 (non-flash)
Nov 03 13:57:43 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619766e-9054-4cc8-90cc-6c01ac983ce5]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:57:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWuvRypO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Successfully updated port: ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquired lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-changed-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Refreshing instance network info cache due to event network-changed-ab31312d-24e1-4230-aa9e-ffc5da3b0690. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] Acquiring lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Releasing lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] Acquired lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Refreshing network info cache for port ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG os_vif [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c804ccdc-75dd-5a5d-8b55-8978195e1ca0', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab31312d-24, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab31312d-24, col_values=(('qos', UUID('73b1842b-98f0-4bef-9bd8-f4b2bee7ce02')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab31312d-24, col_values=(('external_ids', {'iface-id': 'ab31312d-24e1-4230-aa9e-ffc5da3b0690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:28:a9', 'vm-uuid': '882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: INFO os_vif [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24')
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] attach device xml: <interface type="ethernet">
Nov 03 13:57:44 user nova-compute[74582]:   <mac address="fa:16:3e:dc:28:a9"/>
Nov 03 13:57:44 user nova-compute[74582]:   <model type="virtio"/>
Nov 03 13:57:44 user nova-compute[74582]:   <mtu size="1442"/>
Nov 03 13:57:44 user nova-compute[74582]:   <target dev="tapab31312d-24"/>
Nov 03 13:57:44 user nova-compute[74582]: </interface>
Nov 03 13:57:44 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26464356536383361', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464356536383361', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:44 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lazy-loading 'flavor' on Instance uuid 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:57:45 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:57:45 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:57:45 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:57:45 user nova-compute[74582]:   <serial>a1860258-04de-41ea-a0c0-2486c1be0d07</serial>
Nov 03 13:57:45 user nova-compute[74582]: </disk>
Nov 03 13:57:45 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-bf0f680d-68e8-4ee3-8bfb-53776c05f944 req-5d6259c7-3f1d-4e4d-ba0a-de032d92ed0c service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bf0f680d-68e8-4ee3-8bfb-53776c05f944 req-5d6259c7-3f1d-4e4d-ba0a-de032d92ed0c service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bf0f680d-68e8-4ee3-8bfb-53776c05f944 req-5d6259c7-3f1d-4e4d-ba0a-de032d92ed0c service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bf0f680d-68e8-4ee3-8bfb-53776c05f944 req-5d6259c7-3f1d-4e4d-ba0a-de032d92ed0c service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-bf0f680d-68e8-4ee3-8bfb-53776c05f944 req-5d6259c7-3f1d-4e4d-ba0a-de032d92ed0c service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:57:45 user nova-compute[74582]: WARNING nova.compute.manager [req-bf0f680d-68e8-4ee3-8bfb-53776c05f944 req-5d6259c7-3f1d-4e4d-ba0a-de032d92ed0c service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 for instance with vm_state active and task_state None.
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updated VIF entry in instance network info cache for port ab31312d-24e1-4230-aa9e-ffc5da3b0690. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d09190e0-be61-4724-a764-5567e43e8aed req-070c9bbf-4dc5-49fd-abc6-60f5f3ec3f53 service nova] Releasing lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No BDM found with device name hda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No VIF found with MAC fa:16:3e:66:92:9b, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 0 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:57:45 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:57:45 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:57:45 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:57:45</nova:creationTime>
Nov 03 13:57:45 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:57:45 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:57:45 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:57:45 user nova-compute[74582]:   <nova:owner>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:57:45 user nova-compute[74582]:   </nova:owner>
Nov 03 13:57:45 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:57:45 user nova-compute[74582]:   <nova:ports>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:57:45 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:57:45 user nova-compute[74582]:     </nova:port>
Nov 03 13:57:45 user nova-compute[74582]:     <nova:port uuid="ab31312d-24e1-4230-aa9e-ffc5da3b0690">
Nov 03 13:57:45 user nova-compute[74582]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 03 13:57:45 user nova-compute[74582]:     </nova:port>
Nov 03 13:57:45 user nova-compute[74582]:   </nova:ports>
Nov 03 13:57:45 user nova-compute[74582]: </nova:instance>
Nov 03 13:57:45 user nova-compute[74582]:  {{(pid=74582) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08fb3a7f-59f8-46cc-a247-3c2901e8b85e tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "interface-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.112s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-changed-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Refreshing instance network info cache due to event network-changed-2cc121ca-a5ae-47ba-9fc3-9c32b7360790. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] Acquiring lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] Acquired lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Refreshing network info cache for port 2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] No VIF found with MAC fa:16:3e:13:c8:ec, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5935fcdc-b5f9-4690-99dc-f974469f5b55 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.557s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'flavor' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'flavor' on Instance uuid c872e44a-e815-4f43-bbea-867d7a189c2e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:46 user nova-compute[74582]: INFO nova.compute.manager [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Attaching volume dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d to /dev/vdb
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.utils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd21e4c6-b0de-4d72-91ee-f371557ac454]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2523fc85-4efb-4076-8afd-25d90f6c7794]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:46 user nova-compute[74582]: INFO nova.compute.manager [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Terminating instance
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.compute.manager [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eadc51-ca70-49ca-9a51-b73e7866ee03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21c8b8-80d6-4330-b13b-471091d2d3b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updated VIF entry in instance network info cache for port 2cc121ca-a5ae-47ba-9fc3-9c32b7360790. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:46 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[866e8c56-906c-403e-8abf-2764c5eebbea]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.utils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating existing volume attachment record: 26849f7e-9682-45e1-8b0c-698acf7c97da {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:46 user nova-compute[74582]: INFO nova.compute.manager [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Attaching volume 5538c4ff-880a-4394-befe-795d914a5cbc to /dev/vdb
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b9db159a-7c0f-42cf-ba80-a067ecad3a13 req-9feed6a6-a2a5-4cff-a5cd-c60b0a01ee27 service nova] Releasing lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.utils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e2d53-18e3-40a8-84f6-6d24b19d28f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51a455-dc55-4592-a350-4e74454c60a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfaccaf-338b-40f2-aff4-5e2bfa972972]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f31711-f3d7-4f46-af00-818bd67baf06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:57:46 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e5ff37-b0b8-4b3d-821a-4f50f9b73024]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG os_brick.utils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating existing volume attachment record: 9fa58ef7-22b0-4b92-bcf4-2c4b296f88da {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-4b013d63-6365-4a00-a3b6-e404f1364acd req-9b5e3651-926c-4886-9255-b2bc4045a507 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-vif-unplugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4b013d63-6365-4a00-a3b6-e404f1364acd req-9b5e3651-926c-4886-9255-b2bc4045a507 service nova] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4b013d63-6365-4a00-a3b6-e404f1364acd req-9b5e3651-926c-4886-9255-b2bc4045a507 service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4b013d63-6365-4a00-a3b6-e404f1364acd req-9b5e3651-926c-4886-9255-b2bc4045a507 service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-4b013d63-6365-4a00-a3b6-e404f1364acd req-9b5e3651-926c-4886-9255-b2bc4045a507 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] No waiting events found dispatching network-vif-unplugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:57:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-4b013d63-6365-4a00-a3b6-e404f1364acd req-9b5e3651-926c-4886-9255-b2bc4045a507 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-vif-unplugged-85877288-7474-44d9-8454-d66125ebe733 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:57:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Instance destroyed successfully.
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.objects.instance [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lazy-loading 'resources' on Instance uuid 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-96593101',display_name='tempest-DeleteServersTestJSON-server-96593101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-96593101',id=20,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be382af3f93a4c059e06948158154021',ramdisk_id='',reservation_id='r-knkbtqvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-835112284',owner_user_name='tempest-DeleteServersTestJSON-835112284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:34Z,user_data=None,user_id='ff612186715a41698e5f6e1bf303556c',uuid=62e9d1f4-c70d-4557-b3a4-fbfca22a1aed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Converting VIF {"id": "85877288-7474-44d9-8454-d66125ebe733", "address": "fa:16:3e:13:c8:ec", "network": {"id": "124c3203-03f0-4b00-904b-a808c6c3f2d9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1564494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be382af3f93a4c059e06948158154021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85877288-74", "ovs_interfaceid": "85877288-7474-44d9-8454-d66125ebe733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_vif [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85877288-74, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2348067-a281-46e0-b17e-6203a7092ef1) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:57:47 user nova-compute[74582]: INFO os_vif [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=85877288-7474-44d9-8454-d66125ebe733,network=Network(124c3203-03f0-4b00-904b-a808c6c3f2d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85877288-74')
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWuvRypO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:47 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cc6335-6c7a-470a-bd45-ca0b33d80c21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:57:47 user nova-compute[74582]: No targets found.
Nov 03 13:57:47 user nova-compute[74582]: iSNS:
Nov 03 13:57:47 user nova-compute[74582]: No targets found.
Nov 03 13:57:47 user nova-compute[74582]: STATIC:
Nov 03 13:57:47 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:57:47 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:47 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:47 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07
Nov 03 13:57:47 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:47 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:47 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:57:47 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:57:47 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:57:47 user nova-compute[74582]: FIRMWARE:
Nov 03 13:57:47 user nova-compute[74582]: No targets found.
Nov 03 13:57:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:57:47 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:57:47 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460931e-4598-4c35-ba2d-77d6df6eee46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[19757aff-0d00-4136-9bbe-b09db1372945]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:47 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:47 user nova-compute[74582]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 (non-flash)
Nov 03 13:57:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:47 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:47 user nova-compute[74582]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 (non-flash)
Nov 03 13:57:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682dd6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-2e75df14-ed9a-4fa0-879c-53cd0a0a0379 req-263e17f3-4f20-4918-a8db-26ae1058ab26 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e75df14-ed9a-4fa0-879c-53cd0a0a0379 req-263e17f3-4f20-4918-a8db-26ae1058ab26 service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e75df14-ed9a-4fa0-879c-53cd0a0a0379 req-263e17f3-4f20-4918-a8db-26ae1058ab26 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e75df14-ed9a-4fa0-879c-53cd0a0a0379 req-263e17f3-4f20-4918-a8db-26ae1058ab26 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-2e75df14-ed9a-4fa0-879c-53cd0a0a0379 req-263e17f3-4f20-4918-a8db-26ae1058ab26 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:57:47 user nova-compute[74582]: WARNING nova.compute.manager [req-2e75df14-ed9a-4fa0-879c-53cd0a0a0379 req-263e17f3-4f20-4918-a8db-26ae1058ab26 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 for instance with vm_state active and task_state None.
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ffb0c1-a6c8-4569-98be-db91131714dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5810fa-03a9-4357-b039-6175b27c4ae3]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[09165eb9-2706-4ece-a92e-fbffffc61198]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76e3753-43e1-4e81-91a6-c151550f2fc5]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c586dc-1e7b-4dff-b947-5b919ea4f85c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2044a3a-897c-440a-bdf7-d371e78cd5d2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260]
Nov 03 13:57:47 user nova-compute[74582]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07, portal: 172.16.0.220,3260] successful.
Nov 03 13:57:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1860258-04de-41ea-a0c0-2486c1be0d07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ea1e0-55cd-45b5-844e-5576dcdf442c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] <== disconnect_volume: return (333ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:57:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Deleting instance files /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed_del
Nov 03 13:57:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Deletion of /opt/stack/data/nova/instances/62e9d1f4-c70d-4557-b3a4-fbfca22a1aed_del complete
Nov 03 13:57:47 user nova-compute[74582]: INFO nova.compute.manager [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 03 13:57:47 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:57:47 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:57:48 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:57:48 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Took 0.51 seconds to deallocate network for instance.
Nov 03 13:57:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] Acquiring lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] No waiting events found dispatching network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:57:48 user nova-compute[74582]: WARNING nova.compute.manager [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received unexpected event network-vif-plugged-85877288-7474-44d9-8454-d66125ebe733 for instance with vm_state active and task_state deleting.
Nov 03 13:57:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-2a0cad35-4f94-4b0d-8abc-965393b79466 req-284b5ef6-253c-45b5-904e-e49978747e54 service nova] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Received event network-vif-deleted-85877288-7474-44d9-8454-d66125ebe733 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:57:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:57:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 13:57:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:54 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOlPwvem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:57:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:57:57 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fa7bc4-0161-4a7e-946c-933071c12171]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:57:57 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1970b0da-d9ec-44a1-a943-93204280e9e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208] added
Nov 03 13:57:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d4383b-1647-473c-a1fd-6c9271a4beb5]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb83d70-4397-4245-80be-4d339e59b5bc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOlPwvem {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOlPwvem" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb43219-7f87-41c3-9ead-1b259c077ba6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iOlPwvem'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c41bfd-8614-40ff-94c3-6f9ad46f24dd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0661b47-5537-413b-89a5-33638717a479]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:57 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:57 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37752e7d-7c61-4339-a7eb-137b709ab16a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260]
Nov 03 13:57:58 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260] successful.
Nov 03 13:57:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279dcc2-31fe-4ddf-982a-220b682a8d25]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ad085-20d4-4087-a75c-e356d0db6e0f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:58 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:58 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:57:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:57:58 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:57:58 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:57:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca09b92-0f7a-4029-b5b2-bcf2846bcc62]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOlPwvem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:57:58 user nova-compute[74582]: INFO nova.compute.manager [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] [instance: 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed] Took 10.73 seconds to detach 1 volumes for instance.
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.793s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] <== connect_volume: return (1795ms) {'type': 'block', 'scsi_wwn': '23762383130356532', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762383130356532', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:57:59 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:57:59 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=25.274311065673828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'flavor' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:59 user nova-compute[74582]: INFO nova.compute.manager [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Terminating instance
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:57:59 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:57:59 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:57:59 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 13:57:59 user nova-compute[74582]:   <serial>a4cb9ffa-9fb1-459d-8e30-6fb1ef332208</serial>
Nov 03 13:57:59 user nova-compute[74582]: </disk>
Nov 03 13:57:59 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf2e0a3e-eb9d-4c54-b099-f4923bbee3a7 req-1ce42249-4dea-4755-8438-faa4fdfe137d service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-vif-unplugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf2e0a3e-eb9d-4c54-b099-f4923bbee3a7 req-1ce42249-4dea-4755-8438-faa4fdfe137d service nova] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf2e0a3e-eb9d-4c54-b099-f4923bbee3a7 req-1ce42249-4dea-4755-8438-faa4fdfe137d service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf2e0a3e-eb9d-4c54-b099-f4923bbee3a7 req-1ce42249-4dea-4755-8438-faa4fdfe137d service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf2e0a3e-eb9d-4c54-b099-f4923bbee3a7 req-1ce42249-4dea-4755-8438-faa4fdfe137d service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] No waiting events found dispatching network-vif-unplugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf2e0a3e-eb9d-4c54-b099-f4923bbee3a7 req-1ce42249-4dea-4755-8438-faa4fdfe137d service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-vif-unplugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:57:59 user nova-compute[74582]: INFO nova.compute.manager [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Terminating instance
Nov 03 13:57:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:57:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] No VIF found with MAC fa:16:3e:08:d4:84, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.180s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.651s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Deleted allocations for instance 62e9d1f4-c70d-4557-b3a4-fbfca22a1aed
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-8b679c57-16f4-4720-bb7b-38fa06284fb0 req-4b1760cb-25f0-40a8-931d-a119615ac5e2 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8b679c57-16f4-4720-bb7b-38fa06284fb0 req-4b1760cb-25f0-40a8-931d-a119615ac5e2 service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8b679c57-16f4-4720-bb7b-38fa06284fb0 req-4b1760cb-25f0-40a8-931d-a119615ac5e2 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8b679c57-16f4-4720-bb7b-38fa06284fb0 req-4b1760cb-25f0-40a8-931d-a119615ac5e2 service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-8b679c57-16f4-4720-bb7b-38fa06284fb0 req-4b1760cb-25f0-40a8-931d-a119615ac5e2 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-8b679c57-16f4-4720-bb7b-38fa06284fb0 req-4b1760cb-25f0-40a8-931d-a119615ac5e2 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-892d0924-77aa-406e-a122-eb70b41b0bdf tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.573s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 24e90b05-29db-4dbd-8916-be21cfcc4041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c872e44a-e815-4f43-bbea-867d7a189c2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03a83f26-21e9-4e06-b32f-f2ce48e85b33 tempest-DeleteServersTestJSON-835112284 tempest-DeleteServersTestJSON-835112284-project-member] Lock "62e9d1f4-c70d-4557-b3a4-fbfca22a1aed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.102s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Instance destroyed successfully.
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'resources' on Instance uuid 24e90b05-29db-4dbd-8916-be21cfcc4041 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-35506629',display_name='tempest-AttachVolumeNegativeTest-server-35506629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-35506629',id=17,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7WIZGfLlcXnI3wufzNCaFU4UUIpOs3LkJwg+7GXXcur1LuEX3xH3QppLmkevW9DCYyaQ7jp2jC5NDV+0f12TUNqIvt+tQ6YbhlLc/DWK7AT6uBUyCqP6ZFbQvYekY+ZQ==',key_name='tempest-keypair-1683901516',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-wyp8cyl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:54:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=24e90b05-29db-4dbd-8916-be21cfcc4041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "address": "fa:16:3e:d1:66:2f", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cbcc2-99", "ovs_interfaceid": "7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG os_vif [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9cbcc2-99, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Instance destroyed successfully.
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'resources' on Instance uuid 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae5b9ced-21eb-41f5-ab16-ff570c22ad60) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2072902535',display_name='tempest-AttachVolumeTestJSON-server-2072902535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2072902535',id=3,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Zduxr769ZPfO/W+9F00C8kK4kJnMhS5OxQSKHpGL0krYyPzdRTbp4LImmRQ2kNhr/tYKwM0yXSiFtsyW31oilOi39ySI68ZtwyprZ7ddxvHrAvthamNTdF12kbqbAWg==',key_name='tempest-keypair-1911277055',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-zms81krr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=0795b1b5-b17d-4cbd-ba36-f8a4de7083c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "address": "fa:16:3e:75:8e:a5", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b20a9c0-1c", "ovs_interfaceid": "2b20a9c0-1c23-4a40-96fc-722cb901bf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG os_vif [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b20a9c0-1c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 13:58:00 user nova-compute[74582]: INFO os_vif [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cbcc2-99')
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Deleting instance files /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041_del
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Deletion of /opt/stack/data/nova/instances/24e90b05-29db-4dbd-8916-be21cfcc4041_del complete
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef24c819-ddbb-4064-a7ef-cd4b53268471) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:00 user nova-compute[74582]: INFO os_vif [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8e:a5,bridge_name='br-int',has_traffic_filtering=True,id=2b20a9c0-1c23-4a40-96fc-722cb901bf56,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b20a9c0-1c')
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Deleting instance files /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2_del
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Deletion of /opt/stack/data/nova/instances/0795b1b5-b17d-4cbd-ba36-f8a4de7083c2_del complete
Nov 03 13:58:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.compute.manager [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:58:00 user nova-compute[74582]: INFO nova.compute.manager [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 03 13:58:00 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:58:00 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:01 user nova-compute[74582]: INFO nova.compute.manager [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Detaching volume a4cb9ffa-9fb1-459d-8e30-6fb1ef332208
Nov 03 13:58:01 user nova-compute[74582]: INFO nova.virt.block_device [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attempting to driver detach volume a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 from mountpoint /dev/vdc
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Attempting to detach device vdc from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:01 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:01 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:58:01 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 13:58:01 user nova-compute[74582]:   <serial>a4cb9ffa-9fb1-459d-8e30-6fb1ef332208</serial>
Nov 03 13:58:01 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 13:58:01 user nova-compute[74582]: </disk>
Nov 03 13:58:01 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Successfully detached device vdc from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the persistent domain config.
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:01 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:01 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:58:01 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 13:58:01 user nova-compute[74582]:   <serial>a4cb9ffa-9fb1-459d-8e30-6fb1ef332208</serial>
Nov 03 13:58:01 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 13:58:01 user nova-compute[74582]: </disk>
Nov 03 13:58:01 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-65e41e0d-aa52-4de9-a0b9-25c16665faf6 req-016efa00-b33c-4089-8871-16df31173c30 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-65e41e0d-aa52-4de9-a0b9-25c16665faf6 req-016efa00-b33c-4089-8871-16df31173c30 service nova] Acquiring lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-65e41e0d-aa52-4de9-a0b9-25c16665faf6 req-016efa00-b33c-4089-8871-16df31173c30 service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-65e41e0d-aa52-4de9-a0b9-25c16665faf6 req-016efa00-b33c-4089-8871-16df31173c30 service nova] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-65e41e0d-aa52-4de9-a0b9-25c16665faf6 req-016efa00-b33c-4089-8871-16df31173c30 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] No waiting events found dispatching network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:01 user nova-compute[74582]: WARNING nova.compute.manager [req-65e41e0d-aa52-4de9-a0b9-25c16665faf6 req-016efa00-b33c-4089-8871-16df31173c30 service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received unexpected event network-vif-plugged-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec for instance with vm_state active and task_state deleting.
Nov 03 13:58:01 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:01 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Took 1.04 seconds to deallocate network for instance.
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:02 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Took 1.27 seconds to deallocate network for instance.
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:02 user nova-compute[74582]: WARNING nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state deleted and task_state None.
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:02 user nova-compute[74582]: WARNING nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state deleted and task_state None.
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:02 user nova-compute[74582]: WARNING nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state deleted and task_state None.
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:02 user nova-compute[74582]: WARNING nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-unplugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state deleted and task_state None.
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-1853c815-0e31-46ae-8502-28a7858887ef req-be820fe2-7b66-4148-bfc6-9284e9ad1fcd service nova] [instance: 24e90b05-29db-4dbd-8916-be21cfcc4041] Received event network-vif-deleted-7a9cbcc2-99d0-4ac4-af3b-fb15b79315ec {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.176s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:02 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Deleted allocations for instance 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-376e4294-8bc6-4a12-81f5-0bc84fdc926b tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:02 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Deleted allocations for instance 24e90b05-29db-4dbd-8916-be21cfcc4041
Nov 03 13:58:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c31f8b7-31d2-4bdc-90b8-dc2f35fe0c9b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "24e90b05-29db-4dbd-8916-be21cfcc4041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-caaaf323-b9cb-454e-9189-d48b95574fd2 req-0cb7a7de-3ebf-4fe3-af17-3efcc3b8e2f3 service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-deleted-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-eef674d1-263b-4d6d-854d-af85a80c4638 req-fa01d86b-960d-4e91-b453-2a12dcbdf5ab service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eef674d1-263b-4d6d-854d-af85a80c4638 req-fa01d86b-960d-4e91-b453-2a12dcbdf5ab service nova] Acquiring lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eef674d1-263b-4d6d-854d-af85a80c4638 req-fa01d86b-960d-4e91-b453-2a12dcbdf5ab service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eef674d1-263b-4d6d-854d-af85a80c4638 req-fa01d86b-960d-4e91-b453-2a12dcbdf5ab service nova] Lock "0795b1b5-b17d-4cbd-ba36-f8a4de7083c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-eef674d1-263b-4d6d-854d-af85a80c4638 req-fa01d86b-960d-4e91-b453-2a12dcbdf5ab service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] No waiting events found dispatching network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:04 user nova-compute[74582]: WARNING nova.compute.manager [req-eef674d1-263b-4d6d-854d-af85a80c4638 req-fa01d86b-960d-4e91-b453-2a12dcbdf5ab service nova] [instance: 0795b1b5-b17d-4cbd-ba36-f8a4de7083c2] Received unexpected event network-vif-plugged-2b20a9c0-1c23-4a40-96fc-722cb901bf56 for instance with vm_state deleted and task_state None.
Nov 03 13:58:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwvQebtg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:08 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:08 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:08 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[98afb302-8a1e-4272-915c-ce28b312bf4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:58:08 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd6e37a-bb74-4bdc-a2a2-5fb5f785389d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d] added
Nov 03 13:58:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c97b00e-7c99-49de-b458-ec5c704b28b7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5c1138-2d94-4bd6-8029-8f527ec6f972]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwvQebtg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwvQebtg" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e0947b-2a5a-47e8-b8ca-ba08236a9388]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwvQebtg'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8367eb8-0a23-4fc1-b8f4-43f4451a48cc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7628cb8-1db3-47d4-b869-b99b7c437152]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f98b51-2883-42cc-8dec-b69ca92360af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260]
Nov 03 13:58:08 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89027b5-36d1-4c81-8159-fc7d7053deec]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee84d8-2557-46ad-a8db-27aa1469375a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:08 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[590356af-06bb-417b-b45b-2cd42df21545]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:58:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwvQebtg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23635356565336662', 'path': '/dev/sde'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635356565336662', 'path': '/dev/sde'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'flavor' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:09 user nova-compute[74582]: INFO nova.compute.manager [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attaching volume c3edd1ac-4bcf-493a-9a95-bf92924d611e to /dev/vdb
Nov 03 13:58:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:58:09 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:09 user nova-compute[74582]:   <source dev="/dev/sde"/>
Nov 03 13:58:09 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:09 user nova-compute[74582]:   <serial>dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d</serial>
Nov 03 13:58:09 user nova-compute[74582]: </disk>
Nov 03 13:58:09 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bbc16d-b568-4238-a143-dca145d0d5c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5115737-5c5b-4ff0-a7b3-73bd891ff0a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88637be3-a8da-4bc3-8185-79372f4d9d52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[601fa416-cb2c-40ca-bd8d-ff3c17440b5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:58:09 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:58:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76837550-bc6f-463e-aa80-cbf81044ddce]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:09 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating existing volume attachment record: fcb9dfd9-ab2b-4c8a-9db1-59cb59a925dc {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:58:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No BDM found with device name hda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] No VIF found with MAC fa:16:3e:66:92:9b, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a378e248-253b-4d0a-91b6-e28bd9ee34ce tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.291s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:12 user nova-compute[74582]: INFO nova.compute.manager [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Detaching volume dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d
Nov 03 13:58:12 user nova-compute[74582]: INFO nova.virt.block_device [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Attempting to driver detach volume dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d from mountpoint /dev/vdb
Nov 03 13:58:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Attempting to detach device vdb from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:58:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:12 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:12 user nova-compute[74582]:   <source dev="/dev/sde"/>
Nov 03 13:58:12 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:12 user nova-compute[74582]:   <serial>dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d</serial>
Nov 03 13:58:12 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 13:58:12 user nova-compute[74582]: </disk>
Nov 03 13:58:12 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully detached device vdb from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the persistent domain config.
Nov 03 13:58:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:58:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:12 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:12 user nova-compute[74582]:   <source dev="/dev/sde"/>
Nov 03 13:58:12 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:12 user nova-compute[74582]:   <serial>dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d</serial>
Nov 03 13:58:12 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 13:58:12 user nova-compute[74582]: </disk>
Nov 03 13:58:12 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXYoMGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:14 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56508e8-b7b1-4e9c-8b72-57830af0ab23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:58:14 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c91fb-05ac-4d6c-b1c4-b8b805abcdf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc] added
Nov 03 13:58:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[611fb0cd-9db8-40a9-9992-7f7c0e1ced94]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[af224753-174b-4a17-b8bc-0b0c43940663]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXYoMGuB {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXYoMGuB" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4516f3a8-48b8-4609-904c-5d889c2e5ded]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXYoMGuB'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc22c092-7626-46d9-95e1-08d9733f1a88]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[607cc035-51e6-4742-b609-0e551b022781]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[df838e32-f06f-48c4-8b5f-46246d6fe707]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260]
Nov 03 13:58:14 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f28bb-7c74-4c7b-ad8e-68ac8540d6db]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[53183716-fa00-4903-9e16-f95a55c12e62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc (non-flash)
Nov 03 13:58:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:14 user nova-compute[74582]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc (non-flash)
Nov 03 13:58:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb411e5-bda1-453f-883d-4e4dd591a68a]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:58:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXYoMGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26361333139626464', 'path': '/dev/sdf'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361333139626464', 'path': '/dev/sdf'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'flavor' on Instance uuid c872e44a-e815-4f43-bbea-867d7a189c2e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:58:15 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:15 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:58:15 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:15 user nova-compute[74582]:   <serial>5538c4ff-880a-4394-befe-795d914a5cbc</serial>
Nov 03 13:58:15 user nova-compute[74582]: </disk>
Nov 03 13:58:15 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:58:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No VIF found with MAC fa:16:3e:b9:07:f2, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5ad4e555-e2b9-4750-8761-47bb444d3603 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.067s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:17 user nova-compute[74582]: INFO nova.compute.manager [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Rebuilding instance
Nov 03 13:58:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:58:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-40e16c7f-45ea-4ee6-a2c2-588fcfa2a8ca req-86c8819f-cd9b-443b-82cc-c5d4337c6530 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-vif-unplugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-40e16c7f-45ea-4ee6-a2c2-588fcfa2a8ca req-86c8819f-cd9b-443b-82cc-c5d4337c6530 service nova] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-40e16c7f-45ea-4ee6-a2c2-588fcfa2a8ca req-86c8819f-cd9b-443b-82cc-c5d4337c6530 service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-40e16c7f-45ea-4ee6-a2c2-588fcfa2a8ca req-86c8819f-cd9b-443b-82cc-c5d4337c6530 service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-40e16c7f-45ea-4ee6-a2c2-588fcfa2a8ca req-86c8819f-cd9b-443b-82cc-c5d4337c6530 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] No waiting events found dispatching network-vif-unplugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:18 user nova-compute[74582]: WARNING nova.compute.manager [req-40e16c7f-45ea-4ee6-a2c2-588fcfa2a8ca req-86c8819f-cd9b-443b-82cc-c5d4337c6530 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received unexpected event network-vif-unplugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 for instance with vm_state active and task_state rebuilding.
Nov 03 13:58:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance destroyed successfully.
Nov 03 13:58:18 user nova-compute[74582]: INFO nova.compute.manager [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Detaching volume 5538c4ff-880a-4394-befe-795d914a5cbc
Nov 03 13:58:19 user nova-compute[74582]: INFO nova.virt.block_device [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Attempting to driver detach volume 5538c4ff-880a-4394-befe-795d914a5cbc from mountpoint /dev/vdb
Nov 03 13:58:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Attempting to detach device vdb from instance c872e44a-e815-4f43-bbea-867d7a189c2e from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:19 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:19 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 13:58:19 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:19 user nova-compute[74582]:   <serial>5538c4ff-880a-4394-befe-795d914a5cbc</serial>
Nov 03 13:58:19 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:58:19 user nova-compute[74582]: </disk>
Nov 03 13:58:19 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully detached device vdb from instance c872e44a-e815-4f43-bbea-867d7a189c2e from the persistent domain config.
Nov 03 13:58:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXYoMGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:19 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb516d-98e1-4f82-9402-2cfa011c9eb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:58:19 user nova-compute[74582]: No targets found.
Nov 03 13:58:19 user nova-compute[74582]: iSNS:
Nov 03 13:58:19 user nova-compute[74582]: No targets found.
Nov 03 13:58:19 user nova-compute[74582]: STATIC:
Nov 03 13:58:19 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208
Nov 03 13:58:19 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:19 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:19 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d
Nov 03 13:58:19 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:19 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:19 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:58:19 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:19 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:19 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc
Nov 03 13:58:19 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:19 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:19 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:58:19 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:19 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:19 user nova-compute[74582]: FIRMWARE:
Nov 03 13:58:19 user nova-compute[74582]: No targets found.
Nov 03 13:58:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:58:19 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:58:19 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d82f6c-47e8-40f1-8999-4002a34fcecd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3585225-c885-466c-80ed-07e285b136bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc (non-flash)
Nov 03 13:58:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:19 user nova-compute[74582]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc (non-flash)
Nov 03 13:58:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68404430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc'): ({'sdf'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Removing single pathed devices sdf {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb63cbee-8e0c-4fc8-a786-bff64155acbe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebafa830-4a8c-438e-a947-23f26d857875]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flushing IO for device /dev/sdf {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d591b1d3-1f05-4d7a-ad2f-fbeceef0f3dc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c2e98a-1cba-4905-af61-5de5cd56d7b2]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[918da09a-d725-4b88-be22-610cfe26c7e6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb3148-b392-43bd-984f-c03930068d95]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260]
Nov 03 13:58:19 user nova-compute[74582]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb2ea66-b655-4d06-9a95-8d6f9a027f3c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== disconnect_volume: return (342ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-1ecc0f38-4f45-4ae5-8c51-08c9742367ec req-cd4a4ad9-af87-4547-8857-9dc215d6ecbd service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1ecc0f38-4f45-4ae5-8c51-08c9742367ec req-cd4a4ad9-af87-4547-8857-9dc215d6ecbd service nova] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1ecc0f38-4f45-4ae5-8c51-08c9742367ec req-cd4a4ad9-af87-4547-8857-9dc215d6ecbd service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1ecc0f38-4f45-4ae5-8c51-08c9742367ec req-cd4a4ad9-af87-4547-8857-9dc215d6ecbd service nova] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-1ecc0f38-4f45-4ae5-8c51-08c9742367ec req-cd4a4ad9-af87-4547-8857-9dc215d6ecbd service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] No waiting events found dispatching network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:20 user nova-compute[74582]: WARNING nova.compute.manager [req-1ecc0f38-4f45-4ae5-8c51-08c9742367ec req-cd4a4ad9-af87-4547-8857-9dc215d6ecbd service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received unexpected event network-vif-plugged-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 for instance with vm_state active and task_state rebuilding.
Nov 03 13:58:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance destroyed successfully.
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-299992870',display_name='tempest-ServerActionsTestOtherA-server-1602014141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-299992870',id=22,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtl0xERP3j+KsAcfY+ZXBsjzwz0w8MMe5s3YYcbBiTVdgqCuN3k7PcBhDOTW6Raj3Gplcn4bqG+K0XUXlRBMOWcRa6tyoa9fwqa2+NVqNaGfC3/MqDB2PyInJ7Hc/fcRA==',key_name='tempest-keypair-1466447300',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:56:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-0yzrsjsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=c872e44a-e815-4f43-bbea-867d7a189c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_vif [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cc121ca-a5, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbd48cdd-ea03-4381-9409-576987b6dfad) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:20 user nova-compute[74582]: INFO os_vif [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5')
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXYoMGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:20 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b19cd-ae44-46a9-83bd-3e895ead0727]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:58:20 user nova-compute[74582]: No targets found.
Nov 03 13:58:20 user nova-compute[74582]: iSNS:
Nov 03 13:58:20 user nova-compute[74582]: No targets found.
Nov 03 13:58:20 user nova-compute[74582]: STATIC:
Nov 03 13:58:20 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208
Nov 03 13:58:20 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:20 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:20 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d
Nov 03 13:58:20 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:20 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:20 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:58:20 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:20 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:20 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:58:20 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:20 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:20 user nova-compute[74582]: FIRMWARE:
Nov 03 13:58:20 user nova-compute[74582]: No targets found.
Nov 03 13:58:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:58:20 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:58:20 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e0259-d9b5-487e-a942-2c355800e5c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5452f5-67e8-42f8-9ef6-4a2932818ddf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:20 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:20 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:20 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:20 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:20 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:20 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f803b9480>, {}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Disconnecting from: [] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== disconnect_volume: return (83ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:58:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Deleting instance files /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e_del
Nov 03 13:58:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Deletion of /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e_del complete
Nov 03 13:58:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:20 user nova-compute[74582]: INFO nova.virt.block_device [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Booting with volume 5538c4ff-880a-4394-befe-795d914a5cbc at /dev/vdb
Nov 03 13:58:20 user nova-compute[74582]: DEBUG os_brick.utils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26bd06d-9e0b-4679-93ed-baa0943c4cde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c8df97-5b8a-438a-9eac-edeca0951727]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81238eb-9db3-4cb4-be3b-0ed9800eb0ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a621a1f-cf3a-4927-b626-9d563c9935bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:58:21 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf959a0-697c-404e-9884-f8fbd1a3f39f]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.utils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating existing volume attachment record: 97bca519-fbf6-4e39-b016-006dc759c1f8 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:58:21 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 is timed out.
Nov 03 13:58:21 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Successfully detached device vdc from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the live domain config.
Nov 03 13:58:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOlPwvem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:21 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1d8ed-37c2-4697-bbd1-7f14cba636ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:58:21 user nova-compute[74582]: No targets found.
Nov 03 13:58:21 user nova-compute[74582]: iSNS:
Nov 03 13:58:21 user nova-compute[74582]: No targets found.
Nov 03 13:58:21 user nova-compute[74582]: STATIC:
Nov 03 13:58:21 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208
Nov 03 13:58:21 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:21 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:21 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d
Nov 03 13:58:21 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:21 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:21 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:58:21 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:21 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:21 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:58:21 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:21 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:21 user nova-compute[74582]: FIRMWARE:
Nov 03 13:58:21 user nova-compute[74582]: No targets found.
Nov 03 13:58:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:58:21 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:58:21 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[20782b3b-21a1-4095-82ea-c3d2878c1788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e6864-101b-4df7-aec9-dcd55e9c405b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:21 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:21 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:21 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:21 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:21 user nova-compute[74582]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 (non-flash)
Nov 03 13:58:21 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68156170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb55a9-00c0-4b1e-afde-4aa98407dfdd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f0047-97de-454b-8335-b2ee69bf8e76]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca52708-e9b3-40b3-aa05-582a85d2ae70]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:58:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3900b255-2698-4a20-89c4-cc3468d76c86]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[220566fc-8d88-44e1-8321-fe27b0784522]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[662427cb-38f1-4fa5-92a8-d11f6d7e04dc]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260]
Nov 03 13:58:22 user nova-compute[74582]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4cb9ffa-9fb1-459d-8e30-6fb1ef332208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3562bf8-3b82-4203-bf68-fac8cf66383b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] <== disconnect_volume: return (383ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.volume.cinder [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Update attachment failed for attachment 97bca519-fbf6-4e39-b016-006dc759c1f8. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Traceback (most recent call last):
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self.driver.rebuild(**kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise NotImplementedError()
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] NotImplementedError
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] During handling of the above exception, another exception occurred:
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Traceback (most recent call last):
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     driver_block_device.attach_block_devices(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     _log_and_attach(device)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._do_attach(context, instance, volume, volume_api,
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._volume_attach(context, volume, connector, instance,
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     connection_info = volume_api.attachment_update(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     res = method(self, ctx, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     with excutils.save_and_reraise_exception():
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self.force_reraise()
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise self.value
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     return method.func(obj, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     resp = self._update('/attachments/%s' % id, body)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     return self.request(url, method, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise exceptions.from_response(resp, body)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: DEBUG nova.compute.utils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe) {{(pid=74582) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Traceback (most recent call last):
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self.driver.rebuild(**kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise NotImplementedError()
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] NotImplementedError
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] During handling of the above exception, another exception occurred:
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Traceback (most recent call last):
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     driver_block_device.attach_block_devices(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     _log_and_attach(device)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._do_attach(context, instance, volume, volume_api,
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._volume_attach(context, volume, connector, instance,
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     connection_info = volume_api.attachment_update(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     res = method(self, ctx, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     with excutils.save_and_reraise_exception():
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self.force_reraise()
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise self.value
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     return method.func(obj, *args, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     resp = self._update('/attachments/%s' % id, body)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     return self.request(url, method, **kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise exceptions.from_response(resp, body)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] During handling of the above exception, another exception occurred:
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Traceback (most recent call last):
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     yield
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._do_rebuild_instance_with_claim(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._do_rebuild_instance(
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     self._rebuild_default_impl(**kwargs)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e]     raise exception.InvalidBDM(str(ex))
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:22 user nova-compute[74582]: ERROR nova.compute.manager [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] 
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'flavor' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3772b5be-22c7-402c-8236-4b583fbd64e7 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:23 user nova-compute[74582]: INFO nova.compute.manager [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server [None req-9d9225e5-2ea5-4107-a3b0-dd0ee5b8396a tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d76ad979-9988-4bbe-8927-f4fad9baf1fe)
Nov 03 13:58:23 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 13:58:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIQirkFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:32 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:32 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:32 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9660d6-8805-438b-8adb-84b171057264]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:58:32 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[932f2fd1-d1bc-46b0-9a08-e0a117e72bfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e] added
Nov 03 13:58:32 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de786b2-584e-4e01-a442-aa15f62fd7c7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d481da-64c7-4a7b-8bea-e17ddb0aaf01]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIQirkFy {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIQirkFy" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f6848-21e7-45ad-81b3-9a10a01c0b07]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIQirkFy'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa88a4-8b27-4e52-9a79-16043e8b7abc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: INFO nova.compute.manager [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] instance snapshotting
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[969de8a8-287a-4a84-b0df-023f521b9a58]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:32 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:32 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Beginning live snapshot process
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[096499e4-ffba-4b85-b048-ebbb980f004f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260]
Nov 03 13:58:32 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:32 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b00348e-fe50-468b-b064-769e34e09a0e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d065a0ac-4492-46e3-8741-1b165477dcab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)
Nov 03 13:58:32 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:32 user nova-compute[74582]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)
Nov 03 13:58:32 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6450a340-ba9d-4929-b208-7d49f3686b87]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIQirkFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb is timed out.
Nov 03 13:58:32 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully detached device vdb from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the live domain config.
Nov 03 13:58:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwvQebtg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:32 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqnmyfhj9/ec0307b41ad845d3983ce54acce6caf5.delta 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqnmyfhj9/ec0307b41ad845d3983ce54acce6caf5.delta 1073741824" returned: 0 in 0.060s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26331643062643735', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331643062643735', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.847s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0461cdc3-9419-4527-a8b3-ad37bb49c22f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:58:33 user nova-compute[74582]: No targets found.
Nov 03 13:58:33 user nova-compute[74582]: iSNS:
Nov 03 13:58:33 user nova-compute[74582]: No targets found.
Nov 03 13:58:33 user nova-compute[74582]: STATIC:
Nov 03 13:58:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d
Nov 03 13:58:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:58:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e
Nov 03 13:58:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:33 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:58:33 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:33 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:33 user nova-compute[74582]: FIRMWARE:
Nov 03 13:58:33 user nova-compute[74582]: No targets found.
Nov 03 13:58:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:58:33 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:58:33 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:58:33 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:33 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:58:33 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:33 user nova-compute[74582]:   <serial>c3edd1ac-4bcf-493a-9a95-bf92924d611e</serial>
Nov 03 13:58:33 user nova-compute[74582]: </disk>
Nov 03 13:58:33 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3cbbc3-fa07-4378-a07e-050abcdc4a35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[574cadf0-01ff-4026-a8eb-6193a6f2c158]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:33 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:33 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:33 user nova-compute[74582]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)
Nov 03 13:58:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:33 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:33 user nova-compute[74582]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d (non-flash)
Nov 03 13:58:33 user nova-compute[74582]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)
Nov 03 13:58:33 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68365b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d'): ({'sde'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Removing single pathed devices sde {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd34fa2-8198-4c96-9a4f-1489c2b9910f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e737c-7140-4a0c-a6b0-2fbd11390935]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Flushing IO for device /dev/sde {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[304e3c91-7186-44f2-bb37-cfc918ba2c8d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:58:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[859161f3-c652-4f67-99c5-d065614b1956]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[779b7226-6eec-4422-828b-53c072d48e27]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --logout" returned: 0 in 0.161s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af838f9-aa6a-4dda-8356-e9ff11556f10]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260]
Nov 03 13:58:34 user nova-compute[74582]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:34 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4cb3d5-9c8d-42b7-b31d-d45ddb61e97d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f10c6b-3de3-45d4-8ac4-e46930fd890f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] <== disconnect_volume: return (1292ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No VIF found with MAC fa:16:3e:40:c0:b6, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 13:58:34 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c16ed850-6964-4cf8-bbb9-40a5dc55cac3 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.994s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:58:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqnmyfhj9/ec0307b41ad845d3983ce54acce6caf5.delta /opt/stack/data/nova/instances/snapshots/tmpqnmyfhj9/ec0307b41ad845d3983ce54acce6caf5 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqnmyfhj9/ec0307b41ad845d3983ce54acce6caf5.delta /opt/stack/data/nova/instances/snapshots/tmpqnmyfhj9/ec0307b41ad845d3983ce54acce6caf5" returned: 0 in 0.450s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:35 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Snapshot extracted, beginning image upload
Nov 03 13:58:35 user nova-compute[74582]: DEBUG nova.objects.instance [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'flavor' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ae472e5-f8ca-40a7-8723-48e99e019c76 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.371s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "interface-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-ab31312d-24e1-4230-aa9e-ffc5da3b0690" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "interface-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-ab31312d-24e1-4230-aa9e-ffc5da3b0690" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.objects.instance [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'flavor' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface> {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface> {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Attempting to detach device tapab31312d-24 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] detach device xml: <interface type="ethernet">
Nov 03 13:58:36 user nova-compute[74582]:   <mac address="fa:16:3e:dc:28:a9"/>
Nov 03 13:58:36 user nova-compute[74582]:   <model type="virtio"/>
Nov 03 13:58:36 user nova-compute[74582]:   <mtu size="1442"/>
Nov 03 13:58:36 user nova-compute[74582]:   <target dev="tapab31312d-24"/>
Nov 03 13:58:36 user nova-compute[74582]: </interface>
Nov 03 13:58:36 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface> {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface>not found in domain: <domain type='kvm' id='25'>
Nov 03 13:58:36 user nova-compute[74582]:   <name>instance-00000015</name>
Nov 03 13:58:36 user nova-compute[74582]:   <uuid>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</uuid>
Nov 03 13:58:36 user nova-compute[74582]:   <metadata>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:36 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:58:36 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:58:36 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:57:45</nova:creationTime>
Nov 03 13:58:36 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:58:36 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:36 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:58:36 user nova-compute[74582]:   <nova:owner>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:58:36 user nova-compute[74582]:   </nova:owner>
Nov 03 13:58:36 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:36 user nova-compute[74582]:   <nova:ports>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:58:36 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:36 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:36 user nova-compute[74582]:     <nova:port uuid="ab31312d-24e1-4230-aa9e-ffc5da3b0690">
Nov 03 13:58:36 user nova-compute[74582]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 03 13:58:36 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:36 user nova-compute[74582]:   </nova:ports>
Nov 03 13:58:36 user nova-compute[74582]: </nova:instance>
Nov 03 13:58:36 user nova-compute[74582]:   </metadata>
Nov 03 13:58:36 user nova-compute[74582]:   <memory unit='KiB'>524288</memory>
Nov 03 13:58:36 user nova-compute[74582]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 13:58:36 user nova-compute[74582]:   <vcpu placement='static'>1</vcpu>
Nov 03 13:58:36 user nova-compute[74582]:   <resource>
Nov 03 13:58:36 user nova-compute[74582]:     <partition>/machine</partition>
Nov 03 13:58:36 user nova-compute[74582]:   </resource>
Nov 03 13:58:36 user nova-compute[74582]:   <sysinfo type='smbios'>
Nov 03 13:58:36 user nova-compute[74582]:     <system>
Nov 03 13:58:36 user nova-compute[74582]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 13:58:36 user nova-compute[74582]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 13:58:36 user nova-compute[74582]:       <entry name='version'>0.0.0</entry>
Nov 03 13:58:36 user nova-compute[74582]:       <entry name='serial'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:36 user nova-compute[74582]:       <entry name='uuid'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:36 user nova-compute[74582]:       <entry name='family'>Virtual Machine</entry>
Nov 03 13:58:36 user nova-compute[74582]:     </system>
Nov 03 13:58:36 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:36 user nova-compute[74582]:   <os>
Nov 03 13:58:36 user nova-compute[74582]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 13:58:36 user nova-compute[74582]:     <boot dev='hd'/>
Nov 03 13:58:36 user nova-compute[74582]:     <smbios mode='sysinfo'/>
Nov 03 13:58:36 user nova-compute[74582]:   </os>
Nov 03 13:58:36 user nova-compute[74582]:   <features>
Nov 03 13:58:36 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:36 user nova-compute[74582]:     <apic/>
Nov 03 13:58:36 user nova-compute[74582]:     <vmcoreinfo state='on'/>
Nov 03 13:58:36 user nova-compute[74582]:   </features>
Nov 03 13:58:36 user nova-compute[74582]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 13:58:36 user nova-compute[74582]:     <model fallback='forbid'>Nehalem</model>
Nov 03 13:58:36 user nova-compute[74582]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 13:58:36 user nova-compute[74582]:     <feature policy='require' name='vme'/>
Nov 03 13:58:36 user nova-compute[74582]:     <feature policy='require' name='x2apic'/>
Nov 03 13:58:36 user nova-compute[74582]:     <feature policy='require' name='hypervisor'/>
Nov 03 13:58:36 user nova-compute[74582]:   </cpu>
Nov 03 13:58:36 user nova-compute[74582]:   <clock offset='utc'>
Nov 03 13:58:36 user nova-compute[74582]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 13:58:36 user nova-compute[74582]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 13:58:36 user nova-compute[74582]:     <timer name='hpet' present='no'/>
Nov 03 13:58:36 user nova-compute[74582]:   </clock>
Nov 03 13:58:36 user nova-compute[74582]:   <on_poweroff>destroy</on_poweroff>
Nov 03 13:58:36 user nova-compute[74582]:   <on_reboot>restart</on_reboot>
Nov 03 13:58:36 user nova-compute[74582]:   <on_crash>destroy</on_crash>
Nov 03 13:58:36 user nova-compute[74582]:   <devices>
Nov 03 13:58:36 user nova-compute[74582]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 13:58:36 user nova-compute[74582]:     <disk type='file' device='disk'>
Nov 03 13:58:36 user nova-compute[74582]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 13:58:36 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk' index='2'/>
Nov 03 13:58:36 user nova-compute[74582]:       <backingStore type='file' index='3'>
Nov 03 13:58:36 user nova-compute[74582]:         <format type='raw'/>
Nov 03 13:58:36 user nova-compute[74582]:         <source file='/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001'/>
Nov 03 13:58:36 user nova-compute[74582]:         <backingStore/>
Nov 03 13:58:36 user nova-compute[74582]:       </backingStore>
Nov 03 13:58:36 user nova-compute[74582]:       <target dev='vda' bus='virtio'/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='virtio-disk0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </disk>
Nov 03 13:58:36 user nova-compute[74582]:     <disk type='file' device='cdrom'>
Nov 03 13:58:36 user nova-compute[74582]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 13:58:36 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config' index='1'/>
Nov 03 13:58:36 user nova-compute[74582]:       <backingStore/>
Nov 03 13:58:36 user nova-compute[74582]:       <target dev='hda' bus='ide'/>
Nov 03 13:58:36 user nova-compute[74582]:       <readonly/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='ide0-0-0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </disk>
Nov 03 13:58:36 user nova-compute[74582]:     <controller type='usb' index='0' model='none'>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='usb'/>
Nov 03 13:58:36 user nova-compute[74582]:     </controller>
Nov 03 13:58:36 user nova-compute[74582]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='pci.0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </controller>
Nov 03 13:58:36 user nova-compute[74582]:     <controller type='ide' index='0'>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='ide'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 13:58:36 user nova-compute[74582]:     </controller>
Nov 03 13:58:36 user nova-compute[74582]:     <interface type='ethernet'>
Nov 03 13:58:36 user nova-compute[74582]:       <mac address='fa:16:3e:66:92:9b'/>
Nov 03 13:58:36 user nova-compute[74582]:       <target dev='tapda2dc401-86'/>
Nov 03 13:58:36 user nova-compute[74582]:       <model type='virtio'/>
Nov 03 13:58:36 user nova-compute[74582]:       <mtu size='1442'/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='net0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </interface>
Nov 03 13:58:36 user nova-compute[74582]:     <interface type='ethernet'>
Nov 03 13:58:36 user nova-compute[74582]:       <mac address='fa:16:3e:dc:28:a9'/>
Nov 03 13:58:36 user nova-compute[74582]:       <target dev='tapab31312d-24'/>
Nov 03 13:58:36 user nova-compute[74582]:       <model type='virtio'/>
Nov 03 13:58:36 user nova-compute[74582]:       <mtu size='1442'/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='net1'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </interface>
Nov 03 13:58:36 user nova-compute[74582]:     <serial type='pty'>
Nov 03 13:58:36 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:36 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:36 user nova-compute[74582]:       <target type='isa-serial' port='0'>
Nov 03 13:58:36 user nova-compute[74582]:         <model name='isa-serial'/>
Nov 03 13:58:36 user nova-compute[74582]:       </target>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </serial>
Nov 03 13:58:36 user nova-compute[74582]:     <console type='pty' tty='/dev/pts/8'>
Nov 03 13:58:36 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:36 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:36 user nova-compute[74582]:       <target type='serial' port='0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </console>
Nov 03 13:58:36 user nova-compute[74582]:     <input type='mouse' bus='ps2'>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='input0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </input>
Nov 03 13:58:36 user nova-compute[74582]:     <input type='keyboard' bus='ps2'>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='input1'/>
Nov 03 13:58:36 user nova-compute[74582]:     </input>
Nov 03 13:58:36 user nova-compute[74582]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 03 13:58:36 user nova-compute[74582]:       <listen type='address' address='0.0.0.0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </graphics>
Nov 03 13:58:36 user nova-compute[74582]:     <audio id='1' type='none'/>
Nov 03 13:58:36 user nova-compute[74582]:     <video>
Nov 03 13:58:36 user nova-compute[74582]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='video0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </video>
Nov 03 13:58:36 user nova-compute[74582]:     <memballoon model='virtio'>
Nov 03 13:58:36 user nova-compute[74582]:       <stats period='10'/>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='balloon0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:36 user nova-compute[74582]:     <rng model='virtio'>
Nov 03 13:58:36 user nova-compute[74582]:       <backend model='random'>/dev/urandom</backend>
Nov 03 13:58:36 user nova-compute[74582]:       <alias name='rng0'/>
Nov 03 13:58:36 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 13:58:36 user nova-compute[74582]:     </rng>
Nov 03 13:58:36 user nova-compute[74582]:   </devices>
Nov 03 13:58:36 user nova-compute[74582]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 13:58:36 user nova-compute[74582]:     <label>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</label>
Nov 03 13:58:36 user nova-compute[74582]:     <imagelabel>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</imagelabel>
Nov 03 13:58:36 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:36 user nova-compute[74582]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 13:58:36 user nova-compute[74582]:     <label>+64055:+108</label>
Nov 03 13:58:36 user nova-compute[74582]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 13:58:36 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:36 user nova-compute[74582]: </domain>
Nov 03 13:58:36 user nova-compute[74582]:  {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 13:58:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully detached device tapab31312d-24 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the persistent domain config.
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] (1/8): Attempting to detach device tapab31312d-24 with device alias net1 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] detach device xml: <interface type="ethernet">
Nov 03 13:58:36 user nova-compute[74582]:   <mac address="fa:16:3e:dc:28:a9"/>
Nov 03 13:58:36 user nova-compute[74582]:   <model type="virtio"/>
Nov 03 13:58:36 user nova-compute[74582]:   <mtu size="1442"/>
Nov 03 13:58:36 user nova-compute[74582]:   <target dev="tapab31312d-24"/>
Nov 03 13:58:36 user nova-compute[74582]: </interface>
Nov 03 13:58:36 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:36 user nova-compute[74582]: INFO nova.compute.manager [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Detaching volume c3edd1ac-4bcf-493a-9a95-bf92924d611e
Nov 03 13:58:36 user nova-compute[74582]: INFO nova.virt.block_device [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attempting to driver detach volume c3edd1ac-4bcf-493a-9a95-bf92924d611e from mountpoint /dev/vdb
Nov 03 13:58:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Attempting to detach device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:36 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:36 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:58:36 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:36 user nova-compute[74582]:   <serial>c3edd1ac-4bcf-493a-9a95-bf92924d611e</serial>
Nov 03 13:58:36 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:58:36 user nova-compute[74582]: </disk>
Nov 03 13:58:36 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Start waiting for the detach event from libvirt for device tapab31312d-24 with device alias net1 for instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:58:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config.
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:36 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:36 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:58:36 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:36 user nova-compute[74582]:   <serial>c3edd1ac-4bcf-493a-9a95-bf92924d611e</serial>
Nov 03 13:58:36 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:58:36 user nova-compute[74582]: </disk>
Nov 03 13:58:36 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-9df6437a-b87f-4508-b606-bed55d8e3a94 req-a1f1bbc3-c680-4bd9-8a2f-04ce3f0088b9 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-unplugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9df6437a-b87f-4508-b606-bed55d8e3a94 req-a1f1bbc3-c680-4bd9-8a2f-04ce3f0088b9 service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9df6437a-b87f-4508-b606-bed55d8e3a94 req-a1f1bbc3-c680-4bd9-8a2f-04ce3f0088b9 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9df6437a-b87f-4508-b606-bed55d8e3a94 req-a1f1bbc3-c680-4bd9-8a2f-04ce3f0088b9 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-9df6437a-b87f-4508-b606-bed55d8e3a94 req-a1f1bbc3-c680-4bd9-8a2f-04ce3f0088b9 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-unplugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:36 user nova-compute[74582]: WARNING nova.compute.manager [req-9df6437a-b87f-4508-b606-bed55d8e3a94 req-a1f1bbc3-c680-4bd9-8a2f-04ce3f0088b9 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-unplugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 for instance with vm_state active and task_state None.
Nov 03 13:58:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:58:38 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Snapshot image upload complete
Nov 03 13:58:38 user nova-compute[74582]: INFO nova.compute.manager [None req-9f1a033a-66e2-4481-bdb4-7859ffec4cb3 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Took 5.73 seconds to snapshot the instance on the hypervisor.
Nov 03 13:58:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e6ba527-d0ad-4539-8b20-84a1e78392f7 req-b865828d-0a7f-44d4-a178-ce356ac03db7 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e6ba527-d0ad-4539-8b20-84a1e78392f7 req-b865828d-0a7f-44d4-a178-ce356ac03db7 service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e6ba527-d0ad-4539-8b20-84a1e78392f7 req-b865828d-0a7f-44d4-a178-ce356ac03db7 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e6ba527-d0ad-4539-8b20-84a1e78392f7 req-b865828d-0a7f-44d4-a178-ce356ac03db7 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e6ba527-d0ad-4539-8b20-84a1e78392f7 req-b865828d-0a7f-44d4-a178-ce356ac03db7 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:39 user nova-compute[74582]: WARNING nova.compute.manager [req-1e6ba527-d0ad-4539-8b20-84a1e78392f7 req-b865828d-0a7f-44d4-a178-ce356ac03db7 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-plugged-ab31312d-24e1-4230-aa9e-ffc5da3b0690 for instance with vm_state active and task_state None.
Nov 03 13:58:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:45 user nova-compute[74582]: INFO nova.compute.manager [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Unshelving
Nov 03 13:58:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'pci_requests' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'numa_topology' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:58:45 user nova-compute[74582]: INFO nova.compute.claims [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Claim successful on node user
Nov 03 13:58:45 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:45 user nova-compute[74582]: INFO nova.network.neutron [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing instance network info cache due to event network-changed-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] Acquiring lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:58:46 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Creating image(s)
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] Acquired lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Refreshing network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG nova.objects.base [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<d9bac93a-31ea-411d-868a-0afb4ff56880> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "c58603dfc15701701af84c529492f4f97d63d203" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "c58603dfc15701701af84c529492f4f97d63d203" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.part --force-share --output=json" returned: 0 in 0.253s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:47 user nova-compute[74582]: DEBUG nova.virt.images [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] 85f70b5b-faad-4b17-96ec-5febee7aca7e was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 13:58:47 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 13:58:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.part /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updated VIF entry in instance network info cache for port f2e2cdf8-b6d0-4d51-b766-518d8ac3915a. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bd5b1890-8918-4cc9-a29b-92b6796c7b74 req-ee6fe630-45a8-4313-a595-2bc30f4a2cc8 service nova] Releasing lock "refresh_cache-d9bac93a-31ea-411d-868a-0afb4ff56880" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.part /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.converted" returned: 0 in 0.256s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "c58603dfc15701701af84c529492f4f97d63d203" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.581s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203 --force-share --output=json" returned: 0 in 0.169s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "c58603dfc15701701af84c529492f4f97d63d203" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "c58603dfc15701701af84c529492f4f97d63d203" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203 --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203,backing_fmt=raw /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203,backing_fmt=raw /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk 1073741824" returned: 0 in 0.047s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "c58603dfc15701701af84c529492f4f97d63d203" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203 --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:48 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'migration_context' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:49 user nova-compute[74582]: DEBUG nova.objects.base [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<d9bac93a-31ea-411d-868a-0afb4ff56880> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:58:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Rebasing disk image.
Nov 03 13:58:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 -F raw /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:49 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 -F raw /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk" returned: 0 in 2.206s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Ensure instance console log exists: /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Start _get_guest_xml network_info=[{"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='55eaa0baee29da92dfbe011dbc0dc1d9',container_format='bare',created_at=2023-11-03T13:56:52Z,direct_url=<?>,disk_format='qcow2',id=85f70b5b-faad-4b17-96ec-5febee7aca7e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-502419754-shelved',owner='9f1d4212d1484dd1b416342134f844e0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T13:56:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:58:51 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:58:51 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='55eaa0baee29da92dfbe011dbc0dc1d9',container_format='bare',created_at=2023-11-03T13:56:52Z,direct_url=<?>,disk_format='qcow2',id=85f70b5b-faad-4b17-96ec-5febee7aca7e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-502419754-shelved',owner='9f1d4212d1484dd1b416342134f844e0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T13:56:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.objects.base [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<d9bac93a-31ea-411d-868a-0afb4ff56880> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-502419754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-502419754',id=18,image_ref='85f70b5b-faad-4b17-96ec-5febee7aca7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-954096694',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:54:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-2b67zupc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member',shelved_at='2023-11-03T13:56:57.205394',shelved_host='user',shelved_image_id='85f70b5b-faad-4b17-96ec-5febee7aca7e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=d9bac93a-31ea-411d-868a-0afb4ff56880,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'pci_devices' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.objects.base [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Object Instance<d9bac93a-31ea-411d-868a-0afb4ff56880> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:58:51 user nova-compute[74582]:   <uuid>d9bac93a-31ea-411d-868a-0afb4ff56880</uuid>
Nov 03 13:58:51 user nova-compute[74582]:   <name>instance-00000012</name>
Nov 03 13:58:51 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:58:51 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:58:51 user nova-compute[74582]:   <metadata>
Nov 03 13:58:51 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:51 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:58:51 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-502419754</nova:name>
Nov 03 13:58:51 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:58:51</nova:creationTime>
Nov 03 13:58:51 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:58:51 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:51 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:58:51 user nova-compute[74582]:       <nova:owner>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:user uuid="b2857caf27f24ebc895421391f498e01">tempest-AttachVolumeShelveTestJSON-1103257092-project-member</nova:user>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:project uuid="9f1d4212d1484dd1b416342134f844e0">tempest-AttachVolumeShelveTestJSON-1103257092</nova:project>
Nov 03 13:58:51 user nova-compute[74582]:       </nova:owner>
Nov 03 13:58:51 user nova-compute[74582]:       <nova:root type="image" uuid="85f70b5b-faad-4b17-96ec-5febee7aca7e"/>
Nov 03 13:58:51 user nova-compute[74582]:       <nova:ports>
Nov 03 13:58:51 user nova-compute[74582]:         <nova:port uuid="f2e2cdf8-b6d0-4d51-b766-518d8ac3915a">
Nov 03 13:58:51 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:51 user nova-compute[74582]:         </nova:port>
Nov 03 13:58:51 user nova-compute[74582]:       </nova:ports>
Nov 03 13:58:51 user nova-compute[74582]:     </nova:instance>
Nov 03 13:58:51 user nova-compute[74582]:   </metadata>
Nov 03 13:58:51 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:58:51 user nova-compute[74582]:     <system>
Nov 03 13:58:51 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:58:51 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:58:51 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:58:51 user nova-compute[74582]:       <entry name="serial">d9bac93a-31ea-411d-868a-0afb4ff56880</entry>
Nov 03 13:58:51 user nova-compute[74582]:       <entry name="uuid">d9bac93a-31ea-411d-868a-0afb4ff56880</entry>
Nov 03 13:58:51 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:58:51 user nova-compute[74582]:     </system>
Nov 03 13:58:51 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:51 user nova-compute[74582]:   <os>
Nov 03 13:58:51 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:58:51 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:58:51 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:58:51 user nova-compute[74582]:   </os>
Nov 03 13:58:51 user nova-compute[74582]:   <features>
Nov 03 13:58:51 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:51 user nova-compute[74582]:     <apic/>
Nov 03 13:58:51 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:58:51 user nova-compute[74582]:   </features>
Nov 03 13:58:51 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:58:51 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:58:51 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:58:51 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:58:51 user nova-compute[74582]:   </clock>
Nov 03 13:58:51 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:58:51 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:58:51 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:58:51 user nova-compute[74582]:   </cpu>
Nov 03 13:58:51 user nova-compute[74582]:   <devices>
Nov 03 13:58:51 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:58:51 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:58:51 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk"/>
Nov 03 13:58:51 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:58:51 user nova-compute[74582]:     </disk>
Nov 03 13:58:51 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:58:51 user nova-compute[74582]:       <mac address="fa:16:3e:df:d8:bc"/>
Nov 03 13:58:51 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:58:51 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:58:51 user nova-compute[74582]:       <target dev="tapf2e2cdf8-b6"/>
Nov 03 13:58:51 user nova-compute[74582]:     </interface>
Nov 03 13:58:51 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:58:51 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/console.log" append="off"/>
Nov 03 13:58:51 user nova-compute[74582]:     </serial>
Nov 03 13:58:51 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:58:51 user nova-compute[74582]:     <video>
Nov 03 13:58:51 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:58:51 user nova-compute[74582]:     </video>
Nov 03 13:58:51 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:58:51 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:58:51 user nova-compute[74582]:     </rng>
Nov 03 13:58:51 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:58:51 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:58:51 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:58:51 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:51 user nova-compute[74582]:   </devices>
Nov 03 13:58:51 user nova-compute[74582]: </domain>
Nov 03 13:58:51 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-502419754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-502419754',id=18,image_ref='85f70b5b-faad-4b17-96ec-5febee7aca7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-954096694',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:54:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-2b67zupc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member',shelved_at='2023-11-03T13:56:57.205394',shelved_host='user',shelved_image_id='85f70b5b-faad-4b17-96ec-5febee7aca7e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=d9bac93a-31ea-411d-868a-0afb4ff56880,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG os_vif [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92ffb31a-7d3b-50c5-8ac3-3c14a5aa7274', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2e2cdf8-b6, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2e2cdf8-b6, col_values=(('qos', UUID('0697fd7e-cad3-4db0-8508-88b28c32245b')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2e2cdf8-b6, col_values=(('external_ids', {'iface-id': 'f2e2cdf8-b6d0-4d51-b766-518d8ac3915a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:d8:bc', 'vm-uuid': 'd9bac93a-31ea-411d-868a-0afb4ff56880'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:51 user nova-compute[74582]: INFO os_vif [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6')
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] No VIF found with MAC fa:16:3e:df:d8:bc, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:51 user nova-compute[74582]: INFO nova.compute.manager [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Detaching volume 96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:58:51 user nova-compute[74582]: INFO nova.virt.block_device [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Attempting to driver detach volume 96feec6f-41a4-4f3f-915e-ebe6aed52df6 from mountpoint /dev/vdb
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Attempting to detach device vdb from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:51 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:51 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:58:51 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:51 user nova-compute[74582]:   <serial>96feec6f-41a4-4f3f-915e-ebe6aed52df6</serial>
Nov 03 13:58:51 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:58:51 user nova-compute[74582]: </disk>
Nov 03 13:58:51 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Successfully detached device vdb from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the persistent domain config.
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 13:58:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 13:58:51 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:58:51 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 13:58:51 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:58:51 user nova-compute[74582]:   <serial>96feec6f-41a4-4f3f-915e-ebe6aed52df6</serial>
Nov 03 13:58:51 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 13:58:51 user nova-compute[74582]: </disk>
Nov 03 13:58:51 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 13:58:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-ca1567eb-f80b-4913-a9bf-8656b633ac5e req-4a356a42-c823-40a7-9b1e-21dee2f256ab service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ca1567eb-f80b-4913-a9bf-8656b633ac5e req-4a356a42-c823-40a7-9b1e-21dee2f256ab service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ca1567eb-f80b-4913-a9bf-8656b633ac5e req-4a356a42-c823-40a7-9b1e-21dee2f256ab service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ca1567eb-f80b-4913-a9bf-8656b633ac5e req-4a356a42-c823-40a7-9b1e-21dee2f256ab service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-ca1567eb-f80b-4913-a9bf-8656b633ac5e req-4a356a42-c823-40a7-9b1e-21dee2f256ab service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:53 user nova-compute[74582]: WARNING nova.compute.manager [req-ca1567eb-f80b-4913-a9bf-8656b633ac5e req-4a356a42-c823-40a7-9b1e-21dee2f256ab service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 13:58:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:54 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:58:55 user nova-compute[74582]: INFO nova.compute.claims [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Claim successful on node user
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.472s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:58:55 user nova-compute[74582]: INFO nova.compute.claims [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Claim successful on node user
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-9843473f-350e-4691-bf19-7bfcd85bfaa7 req-492f73fd-3d63-4d8f-939b-43401166c401 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9843473f-350e-4691-bf19-7bfcd85bfaa7 req-492f73fd-3d63-4d8f-939b-43401166c401 service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9843473f-350e-4691-bf19-7bfcd85bfaa7 req-492f73fd-3d63-4d8f-939b-43401166c401 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9843473f-350e-4691-bf19-7bfcd85bfaa7 req-492f73fd-3d63-4d8f-939b-43401166c401 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-9843473f-350e-4691-bf19-7bfcd85bfaa7 req-492f73fd-3d63-4d8f-939b-43401166c401 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:58:55 user nova-compute[74582]: WARNING nova.compute.manager [req-9843473f-350e-4691-bf19-7bfcd85bfaa7 req-492f73fd-3d63-4d8f-939b-43401166c401 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 13:58:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:58:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:58:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance spawned successfully.
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.policy [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f64445061a214d13992b8b3bbacfb0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd438a60c19854c4a93593908fb9b4390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:58:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Creating image(s)
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "/opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "/opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.263s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4c6c97ab-d094-4f8d-8d65-9c7951c4be02 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.378s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.policy [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ee2e8967900436e874e86e6dd64ce72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867ccc345ce547daa6a83fe5f13c74b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.210s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk 1073741824" returned: 0 in 0.061s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 13:58:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Creating image(s)
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "/opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "/opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "/opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:56 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Waiting for libvirt event about the detach of device tapab31312d-24 with device alias net1 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb is timed out.
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface> {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface>not found in domain: <domain type='kvm' id='25'>
Nov 03 13:58:56 user nova-compute[74582]:   <name>instance-00000015</name>
Nov 03 13:58:56 user nova-compute[74582]:   <uuid>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</uuid>
Nov 03 13:58:56 user nova-compute[74582]:   <metadata>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:56 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:57:45</nova:creationTime>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:58:56 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:56 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:owner>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:58:56 user nova-compute[74582]:   </nova:owner>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:ports>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:58:56 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:56 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:port uuid="ab31312d-24e1-4230-aa9e-ffc5da3b0690">
Nov 03 13:58:56 user nova-compute[74582]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 03 13:58:56 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:56 user nova-compute[74582]:   </nova:ports>
Nov 03 13:58:56 user nova-compute[74582]: </nova:instance>
Nov 03 13:58:56 user nova-compute[74582]:   </metadata>
Nov 03 13:58:56 user nova-compute[74582]:   <memory unit='KiB'>524288</memory>
Nov 03 13:58:56 user nova-compute[74582]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 13:58:56 user nova-compute[74582]:   <vcpu placement='static'>1</vcpu>
Nov 03 13:58:56 user nova-compute[74582]:   <resource>
Nov 03 13:58:56 user nova-compute[74582]:     <partition>/machine</partition>
Nov 03 13:58:56 user nova-compute[74582]:   </resource>
Nov 03 13:58:56 user nova-compute[74582]:   <sysinfo type='smbios'>
Nov 03 13:58:56 user nova-compute[74582]:     <system>
Nov 03 13:58:56 user nova-compute[74582]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 13:58:56 user nova-compute[74582]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 13:58:56 user nova-compute[74582]:       <entry name='version'>0.0.0</entry>
Nov 03 13:58:56 user nova-compute[74582]:       <entry name='serial'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:56 user nova-compute[74582]:       <entry name='uuid'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:56 user nova-compute[74582]:       <entry name='family'>Virtual Machine</entry>
Nov 03 13:58:56 user nova-compute[74582]:     </system>
Nov 03 13:58:56 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:56 user nova-compute[74582]:   <os>
Nov 03 13:58:56 user nova-compute[74582]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 13:58:56 user nova-compute[74582]:     <boot dev='hd'/>
Nov 03 13:58:56 user nova-compute[74582]:     <smbios mode='sysinfo'/>
Nov 03 13:58:56 user nova-compute[74582]:   </os>
Nov 03 13:58:56 user nova-compute[74582]:   <features>
Nov 03 13:58:56 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:56 user nova-compute[74582]:     <apic/>
Nov 03 13:58:56 user nova-compute[74582]:     <vmcoreinfo state='on'/>
Nov 03 13:58:56 user nova-compute[74582]:   </features>
Nov 03 13:58:56 user nova-compute[74582]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 13:58:56 user nova-compute[74582]:     <model fallback='forbid'>Nehalem</model>
Nov 03 13:58:56 user nova-compute[74582]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 13:58:56 user nova-compute[74582]:     <feature policy='require' name='vme'/>
Nov 03 13:58:56 user nova-compute[74582]:     <feature policy='require' name='x2apic'/>
Nov 03 13:58:56 user nova-compute[74582]:     <feature policy='require' name='hypervisor'/>
Nov 03 13:58:56 user nova-compute[74582]:   </cpu>
Nov 03 13:58:56 user nova-compute[74582]:   <clock offset='utc'>
Nov 03 13:58:56 user nova-compute[74582]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 13:58:56 user nova-compute[74582]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 13:58:56 user nova-compute[74582]:     <timer name='hpet' present='no'/>
Nov 03 13:58:56 user nova-compute[74582]:   </clock>
Nov 03 13:58:56 user nova-compute[74582]:   <on_poweroff>destroy</on_poweroff>
Nov 03 13:58:56 user nova-compute[74582]:   <on_reboot>restart</on_reboot>
Nov 03 13:58:56 user nova-compute[74582]:   <on_crash>destroy</on_crash>
Nov 03 13:58:56 user nova-compute[74582]:   <devices>
Nov 03 13:58:56 user nova-compute[74582]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 13:58:56 user nova-compute[74582]:     <disk type='file' device='disk'>
Nov 03 13:58:56 user nova-compute[74582]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 13:58:56 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk' index='2'/>
Nov 03 13:58:56 user nova-compute[74582]:       <backingStore type='file' index='3'>
Nov 03 13:58:56 user nova-compute[74582]:         <format type='raw'/>
Nov 03 13:58:56 user nova-compute[74582]:         <source file='/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001'/>
Nov 03 13:58:56 user nova-compute[74582]:         <backingStore/>
Nov 03 13:58:56 user nova-compute[74582]:       </backingStore>
Nov 03 13:58:56 user nova-compute[74582]:       <target dev='vda' bus='virtio'/>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='virtio-disk0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </disk>
Nov 03 13:58:56 user nova-compute[74582]:     <disk type='file' device='cdrom'>
Nov 03 13:58:56 user nova-compute[74582]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 13:58:56 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config' index='1'/>
Nov 03 13:58:56 user nova-compute[74582]:       <backingStore/>
Nov 03 13:58:56 user nova-compute[74582]:       <target dev='hda' bus='ide'/>
Nov 03 13:58:56 user nova-compute[74582]:       <readonly/>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='ide0-0-0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </disk>
Nov 03 13:58:56 user nova-compute[74582]:     <controller type='usb' index='0' model='none'>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='usb'/>
Nov 03 13:58:56 user nova-compute[74582]:     </controller>
Nov 03 13:58:56 user nova-compute[74582]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='pci.0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </controller>
Nov 03 13:58:56 user nova-compute[74582]:     <controller type='ide' index='0'>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='ide'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 13:58:56 user nova-compute[74582]:     </controller>
Nov 03 13:58:56 user nova-compute[74582]:     <interface type='ethernet'>
Nov 03 13:58:56 user nova-compute[74582]:       <mac address='fa:16:3e:66:92:9b'/>
Nov 03 13:58:56 user nova-compute[74582]:       <target dev='tapda2dc401-86'/>
Nov 03 13:58:56 user nova-compute[74582]:       <model type='virtio'/>
Nov 03 13:58:56 user nova-compute[74582]:       <mtu size='1442'/>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='net0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </interface>
Nov 03 13:58:56 user nova-compute[74582]:     <serial type='pty'>
Nov 03 13:58:56 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:56 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:56 user nova-compute[74582]:       <target type='isa-serial' port='0'>
Nov 03 13:58:56 user nova-compute[74582]:         <model name='isa-serial'/>
Nov 03 13:58:56 user nova-compute[74582]:       </target>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </serial>
Nov 03 13:58:56 user nova-compute[74582]:     <console type='pty' tty='/dev/pts/8'>
Nov 03 13:58:56 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:56 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:56 user nova-compute[74582]:       <target type='serial' port='0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </console>
Nov 03 13:58:56 user nova-compute[74582]:     <input type='mouse' bus='ps2'>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='input0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </input>
Nov 03 13:58:56 user nova-compute[74582]:     <input type='keyboard' bus='ps2'>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='input1'/>
Nov 03 13:58:56 user nova-compute[74582]:     </input>
Nov 03 13:58:56 user nova-compute[74582]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 03 13:58:56 user nova-compute[74582]:       <listen type='address' address='0.0.0.0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </graphics>
Nov 03 13:58:56 user nova-compute[74582]:     <audio id='1' type='none'/>
Nov 03 13:58:56 user nova-compute[74582]:     <video>
Nov 03 13:58:56 user nova-compute[74582]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='video0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </video>
Nov 03 13:58:56 user nova-compute[74582]:     <memballoon model='virtio'>
Nov 03 13:58:56 user nova-compute[74582]:       <stats period='10'/>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='balloon0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:56 user nova-compute[74582]:     <rng model='virtio'>
Nov 03 13:58:56 user nova-compute[74582]:       <backend model='random'>/dev/urandom</backend>
Nov 03 13:58:56 user nova-compute[74582]:       <alias name='rng0'/>
Nov 03 13:58:56 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 13:58:56 user nova-compute[74582]:     </rng>
Nov 03 13:58:56 user nova-compute[74582]:   </devices>
Nov 03 13:58:56 user nova-compute[74582]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 13:58:56 user nova-compute[74582]:     <label>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</label>
Nov 03 13:58:56 user nova-compute[74582]:     <imagelabel>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</imagelabel>
Nov 03 13:58:56 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:56 user nova-compute[74582]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 13:58:56 user nova-compute[74582]:     <label>+64055:+108</label>
Nov 03 13:58:56 user nova-compute[74582]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 13:58:56 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:56 user nova-compute[74582]: </domain>
Nov 03 13:58:56 user nova-compute[74582]:  {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 13:58:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully detached device tapab31312d-24 from instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb from the live domain config.
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG os_vif [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab31312d-24, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73b1842b-98f0-4bef-9bd8-f4b2bee7ce02) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:56 user nova-compute[74582]: INFO os_vif [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24')
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:56 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:58:56</nova:creationTime>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:58:56 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:56 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:owner>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:58:56 user nova-compute[74582]:   </nova:owner>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:56 user nova-compute[74582]:   <nova:ports>
Nov 03 13:58:56 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:58:56 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:56 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:56 user nova-compute[74582]:   </nova:ports>
Nov 03 13:58:56 user nova-compute[74582]: </nova:instance>
Nov 03 13:58:56 user nova-compute[74582]:  {{(pid=74582) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.202s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Cannot resize image /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Ensure instance console log exists: /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.218s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Successfully created port: ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk 1073741824" returned: 0 in 0.066s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 is timed out.
Nov 03 13:58:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config.
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIQirkFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:58:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156b665-6e9e-4f65-b863-ecdb3ca43fe6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:58:57 user nova-compute[74582]: No targets found.
Nov 03 13:58:57 user nova-compute[74582]: iSNS:
Nov 03 13:58:57 user nova-compute[74582]: No targets found.
Nov 03 13:58:57 user nova-compute[74582]: STATIC:
Nov 03 13:58:57 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:58:57 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:57 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:57 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e
Nov 03 13:58:57 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:57 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:57 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:58:57 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:58:57 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:58:57 user nova-compute[74582]: FIRMWARE:
Nov 03 13:58:57 user nova-compute[74582]: No targets found.
Nov 03 13:58:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:58:57 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:58:57 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41f62a-b699-4271-8503-fb551eed839a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46849cf9-34e5-42e7-869e-b5c2faaec8a0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:57 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:57 user nova-compute[74582]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)
Nov 03 13:58:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:58:57 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:58:57 user nova-compute[74582]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e (non-flash)
Nov 03 13:58:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683664d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39de43d-bcc3-4334-83a1-5aa3f8bd160c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983de07-443a-4d6e-9a99-78802fd39df8]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f2e41-9565-436d-8e6f-2c634ab799ee]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.254s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f713e-e73d-4a98-951c-17eccc0b8b11]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e05142-4b3c-444e-932b-d7d8abc49068]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1888fd2c-fa05-4673-8820-aeb690ca10cc]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260]
Nov 03 13:58:57 user nova-compute[74582]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e, portal: 172.16.0.220,3260] successful.
Nov 03 13:58:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Cannot resize image /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Ensure instance console log exists: /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3edd1ac-4bcf-493a-9a95-bf92924d611e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fe4f7d-58a7-474a-8f33-40e7929f8f1d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== disconnect_volume: return (458ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Successfully created port: 5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquired lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-deleted-ab31312d-24e1-4230-aa9e-ffc5da3b0690 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:57 user nova-compute[74582]: INFO nova.compute.manager [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Neutron deleted interface ab31312d-24e1-4230-aa9e-ffc5da3b0690; detaching it from the instance and deleting it from the info cache
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG nova.objects.instance [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Lazy-loading 'system_metadata' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.objects.instance [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Lazy-loading 'flavor' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.objects.base [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Object Instance<882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb> lazy-loaded attributes: system_metadata,flavor {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Converting VIF {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface> {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface>not found in domain: <domain type='kvm' id='25'>
Nov 03 13:58:58 user nova-compute[74582]:   <name>instance-00000015</name>
Nov 03 13:58:58 user nova-compute[74582]:   <uuid>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</uuid>
Nov 03 13:58:58 user nova-compute[74582]:   <metadata>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:58 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:58:56</nova:creationTime>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:58:58 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:ports>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:58:58 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:58 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:ports>
Nov 03 13:58:58 user nova-compute[74582]: </nova:instance>
Nov 03 13:58:58 user nova-compute[74582]:   </metadata>
Nov 03 13:58:58 user nova-compute[74582]:   <memory unit='KiB'>524288</memory>
Nov 03 13:58:58 user nova-compute[74582]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 13:58:58 user nova-compute[74582]:   <vcpu placement='static'>1</vcpu>
Nov 03 13:58:58 user nova-compute[74582]:   <resource>
Nov 03 13:58:58 user nova-compute[74582]:     <partition>/machine</partition>
Nov 03 13:58:58 user nova-compute[74582]:   </resource>
Nov 03 13:58:58 user nova-compute[74582]:   <sysinfo type='smbios'>
Nov 03 13:58:58 user nova-compute[74582]:     <system>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='version'>0.0.0</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='serial'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='uuid'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='family'>Virtual Machine</entry>
Nov 03 13:58:58 user nova-compute[74582]:     </system>
Nov 03 13:58:58 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:58 user nova-compute[74582]:   <os>
Nov 03 13:58:58 user nova-compute[74582]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 13:58:58 user nova-compute[74582]:     <boot dev='hd'/>
Nov 03 13:58:58 user nova-compute[74582]:     <smbios mode='sysinfo'/>
Nov 03 13:58:58 user nova-compute[74582]:   </os>
Nov 03 13:58:58 user nova-compute[74582]:   <features>
Nov 03 13:58:58 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:58 user nova-compute[74582]:     <apic/>
Nov 03 13:58:58 user nova-compute[74582]:     <vmcoreinfo state='on'/>
Nov 03 13:58:58 user nova-compute[74582]:   </features>
Nov 03 13:58:58 user nova-compute[74582]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 13:58:58 user nova-compute[74582]:     <model fallback='forbid'>Nehalem</model>
Nov 03 13:58:58 user nova-compute[74582]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 13:58:58 user nova-compute[74582]:     <feature policy='require' name='vme'/>
Nov 03 13:58:58 user nova-compute[74582]:     <feature policy='require' name='x2apic'/>
Nov 03 13:58:58 user nova-compute[74582]:     <feature policy='require' name='hypervisor'/>
Nov 03 13:58:58 user nova-compute[74582]:   </cpu>
Nov 03 13:58:58 user nova-compute[74582]:   <clock offset='utc'>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name='hpet' present='no'/>
Nov 03 13:58:58 user nova-compute[74582]:   </clock>
Nov 03 13:58:58 user nova-compute[74582]:   <on_poweroff>destroy</on_poweroff>
Nov 03 13:58:58 user nova-compute[74582]:   <on_reboot>restart</on_reboot>
Nov 03 13:58:58 user nova-compute[74582]:   <on_crash>destroy</on_crash>
Nov 03 13:58:58 user nova-compute[74582]:   <devices>
Nov 03 13:58:58 user nova-compute[74582]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 13:58:58 user nova-compute[74582]:     <disk type='file' device='disk'>
Nov 03 13:58:58 user nova-compute[74582]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 13:58:58 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk' index='2'/>
Nov 03 13:58:58 user nova-compute[74582]:       <backingStore type='file' index='3'>
Nov 03 13:58:58 user nova-compute[74582]:         <format type='raw'/>
Nov 03 13:58:58 user nova-compute[74582]:         <source file='/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001'/>
Nov 03 13:58:58 user nova-compute[74582]:         <backingStore/>
Nov 03 13:58:58 user nova-compute[74582]:       </backingStore>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev='vda' bus='virtio'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='virtio-disk0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </disk>
Nov 03 13:58:58 user nova-compute[74582]:     <disk type='file' device='cdrom'>
Nov 03 13:58:58 user nova-compute[74582]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 13:58:58 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config' index='1'/>
Nov 03 13:58:58 user nova-compute[74582]:       <backingStore/>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev='hda' bus='ide'/>
Nov 03 13:58:58 user nova-compute[74582]:       <readonly/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='ide0-0-0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </disk>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type='usb' index='0' model='none'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='usb'/>
Nov 03 13:58:58 user nova-compute[74582]:     </controller>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='pci.0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </controller>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type='ide' index='0'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='ide'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 13:58:58 user nova-compute[74582]:     </controller>
Nov 03 13:58:58 user nova-compute[74582]:     <interface type='ethernet'>
Nov 03 13:58:58 user nova-compute[74582]:       <mac address='fa:16:3e:66:92:9b'/>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev='tapda2dc401-86'/>
Nov 03 13:58:58 user nova-compute[74582]:       <model type='virtio'/>
Nov 03 13:58:58 user nova-compute[74582]:       <mtu size='1442'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='net0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </interface>
Nov 03 13:58:58 user nova-compute[74582]:     <serial type='pty'>
Nov 03 13:58:58 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:58 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:58 user nova-compute[74582]:       <target type='isa-serial' port='0'>
Nov 03 13:58:58 user nova-compute[74582]:         <model name='isa-serial'/>
Nov 03 13:58:58 user nova-compute[74582]:       </target>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </serial>
Nov 03 13:58:58 user nova-compute[74582]:     <console type='pty' tty='/dev/pts/8'>
Nov 03 13:58:58 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:58 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:58 user nova-compute[74582]:       <target type='serial' port='0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </console>
Nov 03 13:58:58 user nova-compute[74582]:     <input type='mouse' bus='ps2'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='input0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </input>
Nov 03 13:58:58 user nova-compute[74582]:     <input type='keyboard' bus='ps2'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='input1'/>
Nov 03 13:58:58 user nova-compute[74582]:     </input>
Nov 03 13:58:58 user nova-compute[74582]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 03 13:58:58 user nova-compute[74582]:       <listen type='address' address='0.0.0.0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </graphics>
Nov 03 13:58:58 user nova-compute[74582]:     <audio id='1' type='none'/>
Nov 03 13:58:58 user nova-compute[74582]:     <video>
Nov 03 13:58:58 user nova-compute[74582]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='video0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </video>
Nov 03 13:58:58 user nova-compute[74582]:     <memballoon model='virtio'>
Nov 03 13:58:58 user nova-compute[74582]:       <stats period='10'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='balloon0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:58 user nova-compute[74582]:     <rng model='virtio'>
Nov 03 13:58:58 user nova-compute[74582]:       <backend model='random'>/dev/urandom</backend>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='rng0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </rng>
Nov 03 13:58:58 user nova-compute[74582]:   </devices>
Nov 03 13:58:58 user nova-compute[74582]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 13:58:58 user nova-compute[74582]:     <label>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</label>
Nov 03 13:58:58 user nova-compute[74582]:     <imagelabel>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</imagelabel>
Nov 03 13:58:58 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:58 user nova-compute[74582]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 13:58:58 user nova-compute[74582]:     <label>+64055:+108</label>
Nov 03 13:58:58 user nova-compute[74582]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 13:58:58 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:58 user nova-compute[74582]: </domain>
Nov 03 13:58:58 user nova-compute[74582]:  {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface> {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:28:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tapab31312d-24"/></interface>not found in domain: <domain type='kvm' id='25'>
Nov 03 13:58:58 user nova-compute[74582]:   <name>instance-00000015</name>
Nov 03 13:58:58 user nova-compute[74582]:   <uuid>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</uuid>
Nov 03 13:58:58 user nova-compute[74582]:   <metadata>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:58 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:58:56</nova:creationTime>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:58:58 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:ports>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:58:58 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:58 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:ports>
Nov 03 13:58:58 user nova-compute[74582]: </nova:instance>
Nov 03 13:58:58 user nova-compute[74582]:   </metadata>
Nov 03 13:58:58 user nova-compute[74582]:   <memory unit='KiB'>524288</memory>
Nov 03 13:58:58 user nova-compute[74582]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 13:58:58 user nova-compute[74582]:   <vcpu placement='static'>1</vcpu>
Nov 03 13:58:58 user nova-compute[74582]:   <resource>
Nov 03 13:58:58 user nova-compute[74582]:     <partition>/machine</partition>
Nov 03 13:58:58 user nova-compute[74582]:   </resource>
Nov 03 13:58:58 user nova-compute[74582]:   <sysinfo type='smbios'>
Nov 03 13:58:58 user nova-compute[74582]:     <system>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='version'>0.0.0</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='serial'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='uuid'>882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name='family'>Virtual Machine</entry>
Nov 03 13:58:58 user nova-compute[74582]:     </system>
Nov 03 13:58:58 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:58 user nova-compute[74582]:   <os>
Nov 03 13:58:58 user nova-compute[74582]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 13:58:58 user nova-compute[74582]:     <boot dev='hd'/>
Nov 03 13:58:58 user nova-compute[74582]:     <smbios mode='sysinfo'/>
Nov 03 13:58:58 user nova-compute[74582]:   </os>
Nov 03 13:58:58 user nova-compute[74582]:   <features>
Nov 03 13:58:58 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:58 user nova-compute[74582]:     <apic/>
Nov 03 13:58:58 user nova-compute[74582]:     <vmcoreinfo state='on'/>
Nov 03 13:58:58 user nova-compute[74582]:   </features>
Nov 03 13:58:58 user nova-compute[74582]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 13:58:58 user nova-compute[74582]:     <model fallback='forbid'>Nehalem</model>
Nov 03 13:58:58 user nova-compute[74582]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 13:58:58 user nova-compute[74582]:     <feature policy='require' name='vme'/>
Nov 03 13:58:58 user nova-compute[74582]:     <feature policy='require' name='x2apic'/>
Nov 03 13:58:58 user nova-compute[74582]:     <feature policy='require' name='hypervisor'/>
Nov 03 13:58:58 user nova-compute[74582]:   </cpu>
Nov 03 13:58:58 user nova-compute[74582]:   <clock offset='utc'>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name='hpet' present='no'/>
Nov 03 13:58:58 user nova-compute[74582]:   </clock>
Nov 03 13:58:58 user nova-compute[74582]:   <on_poweroff>destroy</on_poweroff>
Nov 03 13:58:58 user nova-compute[74582]:   <on_reboot>restart</on_reboot>
Nov 03 13:58:58 user nova-compute[74582]:   <on_crash>destroy</on_crash>
Nov 03 13:58:58 user nova-compute[74582]:   <devices>
Nov 03 13:58:58 user nova-compute[74582]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 13:58:58 user nova-compute[74582]:     <disk type='file' device='disk'>
Nov 03 13:58:58 user nova-compute[74582]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 13:58:58 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk' index='2'/>
Nov 03 13:58:58 user nova-compute[74582]:       <backingStore type='file' index='3'>
Nov 03 13:58:58 user nova-compute[74582]:         <format type='raw'/>
Nov 03 13:58:58 user nova-compute[74582]:         <source file='/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001'/>
Nov 03 13:58:58 user nova-compute[74582]:         <backingStore/>
Nov 03 13:58:58 user nova-compute[74582]:       </backingStore>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev='vda' bus='virtio'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='virtio-disk0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </disk>
Nov 03 13:58:58 user nova-compute[74582]:     <disk type='file' device='cdrom'>
Nov 03 13:58:58 user nova-compute[74582]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 13:58:58 user nova-compute[74582]:       <source file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk.config' index='1'/>
Nov 03 13:58:58 user nova-compute[74582]:       <backingStore/>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev='hda' bus='ide'/>
Nov 03 13:58:58 user nova-compute[74582]:       <readonly/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='ide0-0-0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </disk>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type='usb' index='0' model='none'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='usb'/>
Nov 03 13:58:58 user nova-compute[74582]:     </controller>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='pci.0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </controller>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type='ide' index='0'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='ide'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 13:58:58 user nova-compute[74582]:     </controller>
Nov 03 13:58:58 user nova-compute[74582]:     <interface type='ethernet'>
Nov 03 13:58:58 user nova-compute[74582]:       <mac address='fa:16:3e:66:92:9b'/>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev='tapda2dc401-86'/>
Nov 03 13:58:58 user nova-compute[74582]:       <model type='virtio'/>
Nov 03 13:58:58 user nova-compute[74582]:       <mtu size='1442'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='net0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </interface>
Nov 03 13:58:58 user nova-compute[74582]:     <serial type='pty'>
Nov 03 13:58:58 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:58 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:58 user nova-compute[74582]:       <target type='isa-serial' port='0'>
Nov 03 13:58:58 user nova-compute[74582]:         <model name='isa-serial'/>
Nov 03 13:58:58 user nova-compute[74582]:       </target>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </serial>
Nov 03 13:58:58 user nova-compute[74582]:     <console type='pty' tty='/dev/pts/8'>
Nov 03 13:58:58 user nova-compute[74582]:       <source path='/dev/pts/8'/>
Nov 03 13:58:58 user nova-compute[74582]:       <log file='/opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/console.log' append='off'/>
Nov 03 13:58:58 user nova-compute[74582]:       <target type='serial' port='0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='serial0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </console>
Nov 03 13:58:58 user nova-compute[74582]:     <input type='mouse' bus='ps2'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='input0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </input>
Nov 03 13:58:58 user nova-compute[74582]:     <input type='keyboard' bus='ps2'>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='input1'/>
Nov 03 13:58:58 user nova-compute[74582]:     </input>
Nov 03 13:58:58 user nova-compute[74582]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 03 13:58:58 user nova-compute[74582]:       <listen type='address' address='0.0.0.0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </graphics>
Nov 03 13:58:58 user nova-compute[74582]:     <audio id='1' type='none'/>
Nov 03 13:58:58 user nova-compute[74582]:     <video>
Nov 03 13:58:58 user nova-compute[74582]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='video0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </video>
Nov 03 13:58:58 user nova-compute[74582]:     <memballoon model='virtio'>
Nov 03 13:58:58 user nova-compute[74582]:       <stats period='10'/>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='balloon0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:58 user nova-compute[74582]:     <rng model='virtio'>
Nov 03 13:58:58 user nova-compute[74582]:       <backend model='random'>/dev/urandom</backend>
Nov 03 13:58:58 user nova-compute[74582]:       <alias name='rng0'/>
Nov 03 13:58:58 user nova-compute[74582]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 13:58:58 user nova-compute[74582]:     </rng>
Nov 03 13:58:58 user nova-compute[74582]:   </devices>
Nov 03 13:58:58 user nova-compute[74582]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 13:58:58 user nova-compute[74582]:     <label>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</label>
Nov 03 13:58:58 user nova-compute[74582]:     <imagelabel>libvirt-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb</imagelabel>
Nov 03 13:58:58 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:58 user nova-compute[74582]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 13:58:58 user nova-compute[74582]:     <label>+64055:+108</label>
Nov 03 13:58:58 user nova-compute[74582]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 13:58:58 user nova-compute[74582]:   </seclabel>
Nov 03 13:58:58 user nova-compute[74582]: </domain>
Nov 03 13:58:58 user nova-compute[74582]:  {{(pid=74582) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 13:58:58 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Detaching interface fa:16:3e:dc:28:a9 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapab31312d-24' not found.
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Converting VIF {"id": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "address": "fa:16:3e:dc:28:a9", "network": {"id": "465af507-a2cd-474d-8592-f0250eacd430", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-840353111", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab31312d-24", "ovs_interfaceid": "ab31312d-24e1-4230-aa9e-ffc5da3b0690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG os_vif [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab31312d-24, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:58:58 user nova-compute[74582]: INFO os_vif [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:28:a9,bridge_name='br-int',has_traffic_filtering=True,id=ab31312d-24e1-4230-aa9e-ffc5da3b0690,network=Network(465af507-a2cd-474d-8592-f0250eacd430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab31312d-24')
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [req-1623a169-feac-444c-85f1-645832b2f4fd req-a23b702b-3088-4bfd-9069-f8407991ef0d service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:58 user nova-compute[74582]:   <nova:package version="0.0.0"/>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:name>tempest-device-tagging-server-386203346</nova:name>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:creationTime>2023-11-03 13:58:58</nova:creationTime>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:flavor name="m1.tiny">
Nov 03 13:58:58 user nova-compute[74582]:     <nova:memory>512</nova:memory>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:disk>1</nova:disk>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:swap>0</nova:swap>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:flavor>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:user uuid="999849806e0342e2ae95e75b749942e2">tempest-TaggedAttachmentsTest-779553221-project-member</nova:user>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:project uuid="1ffcb22b31c948d7a2b7bd1587392f91">tempest-TaggedAttachmentsTest-779553221</nova:project>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:58 user nova-compute[74582]:   <nova:ports>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:port uuid="da2dc401-86fb-41d5-a28a-00da537e742a">
Nov 03 13:58:58 user nova-compute[74582]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 13:58:58 user nova-compute[74582]:     </nova:port>
Nov 03 13:58:58 user nova-compute[74582]:   </nova:ports>
Nov 03 13:58:58 user nova-compute[74582]: </nova:instance>
Nov 03 13:58:58 user nova-compute[74582]:  {{(pid=74582) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Successfully updated port: ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquired lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-changed-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Refreshing instance network info cache due to event network-changed-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] Acquiring lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:58 user nova-compute[74582]: INFO nova.network.neutron [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Port ab31312d-24e1-4230-aa9e-ffc5da3b0690 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [{"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updating instance_info_cache with network_info: [{"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Releasing lock "refresh_cache-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Releasing lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Instance network_info: |[{"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] Acquired lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Refreshing network info cache for port ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Start _get_guest_xml network_info=[{"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0ea78f0a-5898-404e-b6c0-0eb725bca093 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "interface-882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-ab31312d-24e1-4230-aa9e-ffc5da3b0690" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.445s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:58 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:58:58 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Successfully updated port: 5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194269537',display_name='tempest-AttachVolumeNegativeTest-server-194269537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194269537',id=24,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZA1k/ambo6LgEKqq90HZCYjoSJ1SBXVSzNYwiEzQ9ibYlHav9EjFdSTiDOBRS7gTcpu50vbwst7ibl0XsYy+CpXq8S8UC809M26ZkF7USmcMfw/W3DiIvN6/i1/yZvWA==',key_name='tempest-keypair-1952785829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-t9ecjx7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=b896be38-f944-448e-8f0c-2ff49fb396a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'pci_devices' on Instance uuid b896be38-f944-448e-8f0c-2ff49fb396a8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquired lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:58:58 user nova-compute[74582]:   <uuid>b896be38-f944-448e-8f0c-2ff49fb396a8</uuid>
Nov 03 13:58:58 user nova-compute[74582]:   <name>instance-00000018</name>
Nov 03 13:58:58 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:58:58 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:58:58 user nova-compute[74582]:   <metadata>
Nov 03 13:58:58 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:58 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:58:58 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeNegativeTest-server-194269537</nova:name>
Nov 03 13:58:58 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:58:58</nova:creationTime>
Nov 03 13:58:58 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:58:58 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:58 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:58:58 user nova-compute[74582]:       <nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:user uuid="f64445061a214d13992b8b3bbacfb0c0">tempest-AttachVolumeNegativeTest-1460772866-project-member</nova:user>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:project uuid="d438a60c19854c4a93593908fb9b4390">tempest-AttachVolumeNegativeTest-1460772866</nova:project>
Nov 03 13:58:58 user nova-compute[74582]:       </nova:owner>
Nov 03 13:58:58 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:58 user nova-compute[74582]:       <nova:ports>
Nov 03 13:58:58 user nova-compute[74582]:         <nova:port uuid="ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92">
Nov 03 13:58:58 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 13:58:58 user nova-compute[74582]:         </nova:port>
Nov 03 13:58:58 user nova-compute[74582]:       </nova:ports>
Nov 03 13:58:58 user nova-compute[74582]:     </nova:instance>
Nov 03 13:58:58 user nova-compute[74582]:   </metadata>
Nov 03 13:58:58 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:58:58 user nova-compute[74582]:     <system>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name="serial">b896be38-f944-448e-8f0c-2ff49fb396a8</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name="uuid">b896be38-f944-448e-8f0c-2ff49fb396a8</entry>
Nov 03 13:58:58 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:58:58 user nova-compute[74582]:     </system>
Nov 03 13:58:58 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:58 user nova-compute[74582]:   <os>
Nov 03 13:58:58 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:58:58 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:58:58 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:58:58 user nova-compute[74582]:   </os>
Nov 03 13:58:58 user nova-compute[74582]:   <features>
Nov 03 13:58:58 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:58 user nova-compute[74582]:     <apic/>
Nov 03 13:58:58 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:58:58 user nova-compute[74582]:   </features>
Nov 03 13:58:58 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:58:58 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:58:58 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:58:58 user nova-compute[74582]:   </clock>
Nov 03 13:58:58 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:58:58 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:58:58 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:58:58 user nova-compute[74582]:   </cpu>
Nov 03 13:58:58 user nova-compute[74582]:   <devices>
Nov 03 13:58:58 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:58:58 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:58:58 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk"/>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:58:58 user nova-compute[74582]:     </disk>
Nov 03 13:58:58 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:58:58 user nova-compute[74582]:       <mac address="fa:16:3e:53:85:ed"/>
Nov 03 13:58:58 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:58:58 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:58:58 user nova-compute[74582]:       <target dev="taped0d2c8b-ee"/>
Nov 03 13:58:58 user nova-compute[74582]:     </interface>
Nov 03 13:58:58 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:58:58 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/console.log" append="off"/>
Nov 03 13:58:58 user nova-compute[74582]:     </serial>
Nov 03 13:58:58 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:58:58 user nova-compute[74582]:     <video>
Nov 03 13:58:58 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:58:58 user nova-compute[74582]:     </video>
Nov 03 13:58:58 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:58:58 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:58:58 user nova-compute[74582]:     </rng>
Nov 03 13:58:58 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:58:58 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:58:58 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:58:58 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:58 user nova-compute[74582]:   </devices>
Nov 03 13:58:58 user nova-compute[74582]: </domain>
Nov 03 13:58:58 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194269537',display_name='tempest-AttachVolumeNegativeTest-server-194269537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194269537',id=24,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZA1k/ambo6LgEKqq90HZCYjoSJ1SBXVSzNYwiEzQ9ibYlHav9EjFdSTiDOBRS7gTcpu50vbwst7ibl0XsYy+CpXq8S8UC809M26ZkF7USmcMfw/W3DiIvN6/i1/yZvWA==',key_name='tempest-keypair-1952785829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-t9ecjx7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=b896be38-f944-448e-8f0c-2ff49fb396a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG os_vif [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19ca63eb-06a7-585c-87d8-d698a17577cf', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped0d2c8b-ee, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped0d2c8b-ee, col_values=(('qos', UUID('b1d1d3a7-4212-40bd-ade3-1cc35f6ce745')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped0d2c8b-ee, col_values=(('external_ids', {'iface-id': 'ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:85:ed', 'vm-uuid': 'b896be38-f944-448e-8f0c-2ff49fb396a8'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: INFO os_vif [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee')
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81bc99e5-134f-4c6b-9fd3-8880fa834819 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.508s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:53:85:ed, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updating instance_info_cache with network_info: [{"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Releasing lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Instance network_info: |[{"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Start _get_guest_xml network_info=[{"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 13:58:59 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:58:59 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updated VIF entry in instance network info cache for port ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updating instance_info_cache with network_info: [{"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2082366770',display_name='tempest-AttachVolumeTestJSON-server-2082366770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2082366770',id=25,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwInQcKOaUJvTmlxyrJMb0cOJ3iqzx3ou+v7kXAe/CqJj1EdMau/0ry4C7M91zffwa7EHaWinDa1YUTL5/DthQmVt1Fabo8cet31/Pyij1d3yPJSQ+Mzx4aS1gutpbhaQ==',key_name='tempest-keypair-1462614157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-hk6a8339',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=defe453f-2cfb-43e0-9e1f-9f5223258982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'pci_devices' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-88001012-bd83-41a9-ae67-083ac03cfbca req-e737800e-e307-4358-b590-3c85cf0f530b service nova] Releasing lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.345s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] End _get_guest_xml xml=<domain type="kvm">
Nov 03 13:58:59 user nova-compute[74582]:   <uuid>defe453f-2cfb-43e0-9e1f-9f5223258982</uuid>
Nov 03 13:58:59 user nova-compute[74582]:   <name>instance-00000019</name>
Nov 03 13:58:59 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 13:58:59 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 13:58:59 user nova-compute[74582]:   <metadata>
Nov 03 13:58:59 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 13:58:59 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 13:58:59 user nova-compute[74582]:       <nova:name>tempest-AttachVolumeTestJSON-server-2082366770</nova:name>
Nov 03 13:58:59 user nova-compute[74582]:       <nova:creationTime>2023-11-03 13:58:59</nova:creationTime>
Nov 03 13:58:59 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 13:58:59 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 13:58:59 user nova-compute[74582]:       </nova:flavor>
Nov 03 13:58:59 user nova-compute[74582]:       <nova:owner>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:user uuid="9ee2e8967900436e874e86e6dd64ce72">tempest-AttachVolumeTestJSON-331837995-project-member</nova:user>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:project uuid="867ccc345ce547daa6a83fe5f13c74b7">tempest-AttachVolumeTestJSON-331837995</nova:project>
Nov 03 13:58:59 user nova-compute[74582]:       </nova:owner>
Nov 03 13:58:59 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 13:58:59 user nova-compute[74582]:       <nova:ports>
Nov 03 13:58:59 user nova-compute[74582]:         <nova:port uuid="5ef92fe0-5804-4f9d-9633-2130066b3030">
Nov 03 13:58:59 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 13:58:59 user nova-compute[74582]:         </nova:port>
Nov 03 13:58:59 user nova-compute[74582]:       </nova:ports>
Nov 03 13:58:59 user nova-compute[74582]:     </nova:instance>
Nov 03 13:58:59 user nova-compute[74582]:   </metadata>
Nov 03 13:58:59 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 13:58:59 user nova-compute[74582]:     <system>
Nov 03 13:58:59 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 13:58:59 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 13:58:59 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 13:58:59 user nova-compute[74582]:       <entry name="serial">defe453f-2cfb-43e0-9e1f-9f5223258982</entry>
Nov 03 13:58:59 user nova-compute[74582]:       <entry name="uuid">defe453f-2cfb-43e0-9e1f-9f5223258982</entry>
Nov 03 13:58:59 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 13:58:59 user nova-compute[74582]:     </system>
Nov 03 13:58:59 user nova-compute[74582]:   </sysinfo>
Nov 03 13:58:59 user nova-compute[74582]:   <os>
Nov 03 13:58:59 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 13:58:59 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 13:58:59 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 13:58:59 user nova-compute[74582]:   </os>
Nov 03 13:58:59 user nova-compute[74582]:   <features>
Nov 03 13:58:59 user nova-compute[74582]:     <acpi/>
Nov 03 13:58:59 user nova-compute[74582]:     <apic/>
Nov 03 13:58:59 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 13:58:59 user nova-compute[74582]:   </features>
Nov 03 13:58:59 user nova-compute[74582]:   <clock offset="utc">
Nov 03 13:58:59 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 13:58:59 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 13:58:59 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 13:58:59 user nova-compute[74582]:   </clock>
Nov 03 13:58:59 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 13:58:59 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 13:58:59 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 13:58:59 user nova-compute[74582]:   </cpu>
Nov 03 13:58:59 user nova-compute[74582]:   <devices>
Nov 03 13:58:59 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 13:58:59 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 13:58:59 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk"/>
Nov 03 13:58:59 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 13:58:59 user nova-compute[74582]:     </disk>
Nov 03 13:58:59 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 13:58:59 user nova-compute[74582]:       <mac address="fa:16:3e:67:ae:69"/>
Nov 03 13:58:59 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:58:59 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 13:58:59 user nova-compute[74582]:       <target dev="tap5ef92fe0-58"/>
Nov 03 13:58:59 user nova-compute[74582]:     </interface>
Nov 03 13:58:59 user nova-compute[74582]:     <serial type="pty">
Nov 03 13:58:59 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/console.log" append="off"/>
Nov 03 13:58:59 user nova-compute[74582]:     </serial>
Nov 03 13:58:59 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 13:58:59 user nova-compute[74582]:     <video>
Nov 03 13:58:59 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 13:58:59 user nova-compute[74582]:     </video>
Nov 03 13:58:59 user nova-compute[74582]:     <rng model="virtio">
Nov 03 13:58:59 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 13:58:59 user nova-compute[74582]:     </rng>
Nov 03 13:58:59 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 13:58:59 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 13:58:59 user nova-compute[74582]:       <stats period="10"/>
Nov 03 13:58:59 user nova-compute[74582]:     </memballoon>
Nov 03 13:58:59 user nova-compute[74582]:   </devices>
Nov 03 13:58:59 user nova-compute[74582]: </domain>
Nov 03 13:58:59 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2082366770',display_name='tempest-AttachVolumeTestJSON-server-2082366770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2082366770',id=25,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwInQcKOaUJvTmlxyrJMb0cOJ3iqzx3ou+v7kXAe/CqJj1EdMau/0ry4C7M91zffwa7EHaWinDa1YUTL5/DthQmVt1Fabo8cet31/Pyij1d3yPJSQ+Mzx4aS1gutpbhaQ==',key_name='tempest-keypair-1462614157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-hk6a8339',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:58:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=defe453f-2cfb-43e0-9e1f-9f5223258982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG os_vif [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29c8fd69-caa5-50fb-8215-2df6ab7f39fd', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef92fe0-58, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ef92fe0-58, col_values=(('qos', UUID('b299346f-43bc-40de-be7e-817d75354856')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ef92fe0-58, col_values=(('external_ids', {'iface-id': '5ef92fe0-5804-4f9d-9633-2130066b3030', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:ae:69', 'vm-uuid': 'defe453f-2cfb-43e0-9e1f-9f5223258982'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:58:59 user nova-compute[74582]: INFO os_vif [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58')
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No VIF found with MAC fa:16:3e:67:ae:69, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-changed-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Refreshing instance network info cache due to event network-changed-5ef92fe0-5804-4f9d-9633-2130066b3030. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] Acquiring lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] Acquired lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:58:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Refreshing network info cache for port 5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updated VIF entry in instance network info cache for port 5ef92fe0-5804-4f9d-9633-2130066b3030. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:59:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updating instance_info_cache with network_info: [{"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-96db27df-2da4-4d99-97dd-e4a7d5437b8b req-f3a809ed-2c24-4fb3-b002-da5407150886 service nova] Releasing lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-b408ca0e-6c07-4285-a044-774aac313174 req-878bec2d-deba-444c-b6bc-8d8d99b4251a service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b408ca0e-6c07-4285-a044-774aac313174 req-878bec2d-deba-444c-b6bc-8d8d99b4251a service nova] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b408ca0e-6c07-4285-a044-774aac313174 req-878bec2d-deba-444c-b6bc-8d8d99b4251a service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b408ca0e-6c07-4285-a044-774aac313174 req-878bec2d-deba-444c-b6bc-8d8d99b4251a service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-b408ca0e-6c07-4285-a044-774aac313174 req-878bec2d-deba-444c-b6bc-8d8d99b4251a service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] No waiting events found dispatching network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:05 user nova-compute[74582]: WARNING nova.compute.manager [req-b408ca0e-6c07-4285-a044-774aac313174 req-878bec2d-deba-444c-b6bc-8d8d99b4251a service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received unexpected event network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 for instance with vm_state building and task_state spawning.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] No waiting events found dispatching network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:05 user nova-compute[74582]: WARNING nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received unexpected event network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 for instance with vm_state building and task_state spawning.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] No waiting events found dispatching network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:05 user nova-compute[74582]: WARNING nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received unexpected event network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 for instance with vm_state building and task_state spawning.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] No waiting events found dispatching network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:05 user nova-compute[74582]: WARNING nova.compute.manager [req-2d8e859c-73a9-47dc-b821-91582ef570a5 req-f51ad772-3929-4a89-a437-d8cec8b3c64c service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received unexpected event network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 for instance with vm_state building and task_state spawning.
Nov 03 13:59:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Instance spawned successfully.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:59:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Instance spawned successfully.
Nov 03 13:59:05 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:59:05 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=25.268722534179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 13:59:05 user nova-compute[74582]: INFO nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Took 8.58 seconds to spawn the instance on the hypervisor.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:59:05 user nova-compute[74582]: INFO nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Took 9.20 seconds to spawn the instance on the hypervisor.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d9bac93a-31ea-411d-868a-0afb4ff56880 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b896be38-f944-448e-8f0c-2ff49fb396a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance defe453f-2cfb-43e0-9e1f-9f5223258982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 13:59:05 user nova-compute[74582]: INFO nova.compute.manager [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Took 10.13 seconds to build instance.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-41ca49ab-f603-43a3-a87b-7b6dffe01a31 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.247s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: INFO nova.compute.manager [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Took 10.22 seconds to build instance.
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-543d966d-76af-4af4-9a73-fdd7dc528bab tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.346s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 is timed out.
Nov 03 13:59:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Successfully detached device vdb from instance 5f2c5d0f-68d6-43b6-803f-6273a2797147 from the live domain config.
Nov 03 13:59:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuTUiHYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:59:12 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb6455-dc54-41e5-86cf-4808b4996c9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 13:59:12 user nova-compute[74582]: No targets found.
Nov 03 13:59:12 user nova-compute[74582]: iSNS:
Nov 03 13:59:12 user nova-compute[74582]: No targets found.
Nov 03 13:59:12 user nova-compute[74582]: STATIC:
Nov 03 13:59:12 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6
Nov 03 13:59:12 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:59:12 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:59:12 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 13:59:12 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 13:59:12 user nova-compute[74582]:                 Iface Name: default
Nov 03 13:59:12 user nova-compute[74582]: FIRMWARE:
Nov 03 13:59:12 user nova-compute[74582]: No targets found.
Nov 03 13:59:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 13:59:12 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 13:59:12 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3da7f65-8c2e-4c28-bfba-135bd28ca6cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27bc61-88ba-4c7b-8354-c21c67775a15]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:59:12 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:59:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:59:12 user nova-compute[74582]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 (non-flash)
Nov 03 13:59:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682d0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3393d42e-f856-414f-be4a-48273258ae56]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[563042cb-68eb-473d-9306-d90afadd5426]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec052da-0e3d-4cd3-bfe1-551874eee525]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff70013-9ce5-4402-896b-d8e87041e298]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8b900e-efad-4c78-9149-b104b089b33b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[569b033e-b726-4bdc-9d69-7b6df8405310]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260]
Nov 03 13:59:12 user nova-compute[74582]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6, portal: 172.16.0.220,3260] successful.
Nov 03 13:59:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96feec6f-41a4-4f3f-915e-ebe6aed52df6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5973e2-bc2f-4310-8f47-fff6d78de5bd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] <== disconnect_volume: return (311ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:59:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 13:59:13 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'flavor' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:59:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9f1e120-030e-4d11-a1da-498499862505 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.248s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:27 user nova-compute[74582]: INFO nova.compute.manager [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Terminating instance
Nov 03 13:59:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-1263bb09-0f06-4c46-9785-5e8b3d5a8f71 req-c76e7713-6ae5-43a6-951a-1d587d379da3 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-unplugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1263bb09-0f06-4c46-9785-5e8b3d5a8f71 req-c76e7713-6ae5-43a6-951a-1d587d379da3 service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1263bb09-0f06-4c46-9785-5e8b3d5a8f71 req-c76e7713-6ae5-43a6-951a-1d587d379da3 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1263bb09-0f06-4c46-9785-5e8b3d5a8f71 req-c76e7713-6ae5-43a6-951a-1d587d379da3 service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-1263bb09-0f06-4c46-9785-5e8b3d5a8f71 req-c76e7713-6ae5-43a6-951a-1d587d379da3 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-unplugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-1263bb09-0f06-4c46-9785-5e8b3d5a8f71 req-c76e7713-6ae5-43a6-951a-1d587d379da3 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-unplugged-da2dc401-86fb-41d5-a28a-00da537e742a for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:59:28 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Instance destroyed successfully.
Nov 03 13:59:28 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lazy-loading 'resources' on Instance uuid 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386203346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386203346',id=21,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8zQDR5MIKhk5KBGUjoL347K12ktq2Zj0QCfqe0UX9WctnTS+cXDuIv5/y1xzKE46eiEXXVTioJr0qwUaYzqS6uF5A9pr0HEGQDNMgpQf+5+Adk9jg10PXi5lKhS4f/xg==',key_name='tempest-keypair-1004604442',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffcb22b31c948d7a2b7bd1587392f91',ramdisk_id='',reservation_id='r-7agidxvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-779553221',owner_user_name='tempest-TaggedAttachmentsTest-779553221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999849806e0342e2ae95e75b749942e2',uuid=882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converting VIF {"id": "da2dc401-86fb-41d5-a28a-00da537e742a", "address": "fa:16:3e:66:92:9b", "network": {"id": "850914e1-a8ac-4edc-9b3b-db6a66280411", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-24022851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffcb22b31c948d7a2b7bd1587392f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2dc401-86", "ovs_interfaceid": "da2dc401-86fb-41d5-a28a-00da537e742a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG os_vif [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda2dc401-86, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16352969-1160-43d9-8ec9-d75c917db7d6) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:59:28 user nova-compute[74582]: INFO os_vif [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:92:9b,bridge_name='br-int',has_traffic_filtering=True,id=da2dc401-86fb-41d5-a28a-00da537e742a,network=Network(850914e1-a8ac-4edc-9b3b-db6a66280411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2dc401-86')
Nov 03 13:59:28 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Deleting instance files /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb_del
Nov 03 13:59:28 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Deletion of /opt/stack/data/nova/instances/882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb_del complete
Nov 03 13:59:28 user nova-compute[74582]: INFO nova.compute.manager [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 03 13:59:28 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:59:28 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:29 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Took 1.13 seconds to deallocate network for instance.
Nov 03 13:59:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-5604b56f-adea-43a3-830e-7a75589eac55 req-652292f0-a918-4305-bc8a-a9298c9077d5 service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-deleted-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebaac82b-bcfc-4be0-bcde-150cbcdfdcc6 req-4f8b839d-2303-47c7-9165-1c6dcc1544af service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received event network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebaac82b-bcfc-4be0-bcde-150cbcdfdcc6 req-4f8b839d-2303-47c7-9165-1c6dcc1544af service nova] Acquiring lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebaac82b-bcfc-4be0-bcde-150cbcdfdcc6 req-4f8b839d-2303-47c7-9165-1c6dcc1544af service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebaac82b-bcfc-4be0-bcde-150cbcdfdcc6 req-4f8b839d-2303-47c7-9165-1c6dcc1544af service nova] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebaac82b-bcfc-4be0-bcde-150cbcdfdcc6 req-4f8b839d-2303-47c7-9165-1c6dcc1544af service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] No waiting events found dispatching network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:29 user nova-compute[74582]: WARNING nova.compute.manager [req-ebaac82b-bcfc-4be0-bcde-150cbcdfdcc6 req-4f8b839d-2303-47c7-9165-1c6dcc1544af service nova] [instance: 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb] Received unexpected event network-vif-plugged-da2dc401-86fb-41d5-a28a-00da537e742a for instance with vm_state active and task_state deleting.
Nov 03 13:59:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:30 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:59:30 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:59:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:30 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Deleted allocations for instance 882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb
Nov 03 13:59:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f060893d-d35b-4f80-8d74-da3cd06f75d2 tempest-TaggedAttachmentsTest-779553221 tempest-TaggedAttachmentsTest-779553221-project-member] Lock "882fdfd8-9f01-4ebc-ae87-d4d6e5dc56fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.141s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:33 user nova-compute[74582]: INFO nova.compute.manager [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attaching volume 12effdff-ef3d-4606-af2a-6723cc009a0b to /dev/vdb
Nov 03 13:59:33 user nova-compute[74582]: DEBUG os_brick.utils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f5f950-bcf3-4299-8c73-86d78c58a48f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5264e3-d3ec-42a5-8c5e-371cc50fbca5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14f35e-a996-4e6e-ad91-bf7f17286071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a9e9c-1133-448b-819c-64ab56fdd975]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:59:33 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:59:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[84034961-6c6d-4743-a071-3285eceaf71c]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG os_brick.utils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:59:33 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating existing volume attachment record: e298730a-39ac-4034-a5ac-d00325f837af {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:59:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "bfd1deec-6150-47c0-b319-02754d07e077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:59:41 user nova-compute[74582]: INFO nova.compute.claims [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Claim successful on node user
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:59:41 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:59:41 user nova-compute[74582]: DEBUG nova.policy [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e900eb8f4f6548f183010bc08a3c66f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc44a2fb46b4a649544d7e506a2d96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:59:41 user nova-compute[74582]: INFO nova.virt.block_device [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Booting with volume-backed-image d1bad2f4-1913-4064-b654-ebb096d97d3b at /dev/vda
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:42 user nova-compute[74582]: INFO nova.compute.manager [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Terminating instance
Nov 03 13:59:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-ef1cddce-a973-4fa8-a839-80941edae8f0 req-14936f1d-a847-4a18-a8d1-cf827ad4fb98 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-unplugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ef1cddce-a973-4fa8-a839-80941edae8f0 req-14936f1d-a847-4a18-a8d1-cf827ad4fb98 service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ef1cddce-a973-4fa8-a839-80941edae8f0 req-14936f1d-a847-4a18-a8d1-cf827ad4fb98 service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ef1cddce-a973-4fa8-a839-80941edae8f0 req-14936f1d-a847-4a18-a8d1-cf827ad4fb98 service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-ef1cddce-a973-4fa8-a839-80941edae8f0 req-14936f1d-a847-4a18-a8d1-cf827ad4fb98 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-unplugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-ef1cddce-a973-4fa8-a839-80941edae8f0 req-14936f1d-a847-4a18-a8d1-cf827ad4fb98 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-unplugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Successfully created port: 8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Instance destroyed successfully.
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lazy-loading 'resources' on Instance uuid 5f2c5d0f-68d6-43b6-803f-6273a2797147 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1943440139',display_name='tempest-TestServerVolumeAttachmentScenario-server-1943440139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1943440139',id=19,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrR+rYEpEH7BxPrZCihb5r4SP8bidG4iM8ZarOTxQ14mEap44GlXlzHq8UwkdkLT9Qha9KabLiU2o/I8xaN4EtEF5UNyaWuoechrDIrAGQb7EMqBufPOeuML8jIXxHLng==',key_name='tempest-keypair-1893500520',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c84669f27ef642dd9f95e40554305974',ramdisk_id='',reservation_id='r-1yg5e0ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-395164084',owner_user_name='tempest-TestServerVolumeAttachmentScenario-395164084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:55:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9062b4b5f9e46b7b25106e57e867533',uuid=5f2c5d0f-68d6-43b6-803f-6273a2797147,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Converting VIF {"id": "22fd01bb-5579-4223-bd50-d9b77f11f886", "address": "fa:16:3e:08:d4:84", "network": {"id": "b0c2851a-49bd-4f41-94cd-3a196fd30e64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1066992044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c84669f27ef642dd9f95e40554305974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01bb-55", "ovs_interfaceid": "22fd01bb-5579-4223-bd50-d9b77f11f886", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG os_vif [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22fd01bb-55, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c43aaa1-4de5-4796-ad06-1f4577ddc001) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: INFO os_vif [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:d4:84,bridge_name='br-int',has_traffic_filtering=True,id=22fd01bb-5579-4223-bd50-d9b77f11f886,network=Network(b0c2851a-49bd-4f41-94cd-3a196fd30e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01bb-55')
Nov 03 13:59:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Deleting instance files /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147_del
Nov 03 13:59:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Deletion of /opt/stack/data/nova/instances/5f2c5d0f-68d6-43b6-803f-6273a2797147_del complete
Nov 03 13:59:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:43 user nova-compute[74582]: INFO nova.compute.manager [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 03 13:59:43 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 13:59:43 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Successfully updated port: 8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-changed-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Refreshing instance network info cache due to event network-changed-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] Acquiring lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating instance_info_cache with network_info: [{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance network_info: |[{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] Acquired lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Refreshing network info cache for port 8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:45 user nova-compute[74582]: WARNING nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received unexpected event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with vm_state active and task_state deleting.
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:45 user nova-compute[74582]: WARNING nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received unexpected event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with vm_state active and task_state deleting.
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:45 user nova-compute[74582]: WARNING nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received unexpected event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with vm_state active and task_state deleting.
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-unplugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-unplugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-unplugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Acquiring lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] No waiting events found dispatching network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 13:59:45 user nova-compute[74582]: WARNING nova.compute.manager [req-3c3b15a7-36ba-4c64-9017-79c2dc1d0de8 req-8c1b7561-82dc-4918-9a5c-64c5d2aa14dc service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received unexpected event network-vif-plugged-22fd01bb-5579-4223-bd50-d9b77f11f886 for instance with vm_state active and task_state deleting.
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:45 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Took 1.87 seconds to deallocate network for instance.
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-b03f4a7e-b963-4ffa-aa9d-6a7e4ac63907 req-ccc28efb-01de-435c-a186-05a863d80f39 service nova] [instance: 5f2c5d0f-68d6-43b6-803f-6273a2797147] Received event network-vif-deleted-22fd01bb-5579-4223-bd50-d9b77f11f886 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updated VIF entry in instance network info cache for port 8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating instance_info_cache with network_info: [{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9aea7ab3-1d60-4ba5-a336-fa47fe202160 req-5ed5a8bf-c491-42b1-921e-f3c63f34fc42 service nova] Releasing lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:45 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:59:46 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:59:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:46 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Deleted allocations for instance 5f2c5d0f-68d6-43b6-803f-6273a2797147
Nov 03 13:59:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f54d6a5a-fb83-486f-a772-696ee74a0768 tempest-TestServerVolumeAttachmentScenario-395164084 tempest-TestServerVolumeAttachmentScenario-395164084-project-member] Lock "5f2c5d0f-68d6-43b6-803f-6273a2797147" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.671s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 13:59:50 user nova-compute[74582]: INFO nova.compute.claims [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Claim successful on node user
Nov 03 13:59:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 13:59:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 13:59:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 13:59:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 13:59:51 user nova-compute[74582]: INFO nova.virt.block_device [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Booting with volume a966bf00-0eb1-41d2-8f70-659557240014 at /dev/vda
Nov 03 13:59:51 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG nova.policy [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '545e5fce790547b8913e2a83ae1a1008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aee9ee017e4336b09fd4bb71033d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[783178ae-3fee-4a28-b3a5-ec24859cf147]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f2907-16d6-418f-aac8-25bc6a51dc81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa9eed2-a0ca-47f9-a236-6fded65c602b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e43270f-c3f1-4219-9f6f-1b12ef89a4fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 13:59:51 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 13:59:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e33204a-99c0-41ec-aa82-72c0433862da]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:59:51 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating existing volume attachment record: 862b2800-30e2-4dde-8734-c45d5cefd259 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 13:59:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully created port: ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:59:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully created port: 7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:59:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully created port: 6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:59:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:59:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully created port: b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:59:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully created port: dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-ee122f85-2da5-48e8-9c09-8df2a931bad2. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f1ad55f6-61e2-407d-9271-4f96d29227ad req-fa885811-fe7f-4b89-8ff4-3925deaa7ce6 service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtcljRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 13:59:55 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:59:55 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 13:59:55 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4705e5-34b5-4c5d-a69c-280e32667ecb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 13:59:55 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.087s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd2c19e-4222-4229-bc1d-dd30a186e2bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b] added
Nov 03 13:59:55 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb534157-c895-4aeb-a1c1-5dcd16924ad2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7165dc4f-b92b-4f80-818b-3c81429015c9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtcljRaX {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtcljRaX" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c638e94b-6201-45fd-a2a7-b57602d59ff2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtcljRaX'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9af051-d256-44a3-ab85-5de980b1d3d3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa02091f-f470-431b-9c54-7030c868e4d9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:59:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:59:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d25a6-9113-4268-b706-4f41552b2f41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260]
Nov 03 13:59:56 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260] successful.
Nov 03 13:59:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6845c5f0-23b0-4764-abcf-50f5251b0e78]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9357d9b2-828f-47bd-a28a-9cf352e35ae0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:59:56 user nova-compute[74582]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b (non-flash)
Nov 03 13:59:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 13:59:56 user nova-compute[74582]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b (non-flash)
Nov 03 13:59:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d90446-bbc6-4031-b043-3a8c1b2a88c1]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtcljRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 13:59:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: 560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26635623338366530', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635623338366530', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 13:59:57 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 13:59:57 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 13:59:57 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 13:59:57 user nova-compute[74582]:   <serial>12effdff-ef3d-4606-af2a-6723cc009a0b</serial>
Nov 03 13:59:57 user nova-compute[74582]: </disk>
Nov 03 13:59:57 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-f0ecf951-377c-4180-a575-8c9a3d3f8cc1. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: 7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-560214e5-1c3e-42e9-a466-bd14a9f9dc7f. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port 560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No VIF found with MAC fa:16:3e:40:c0:b6, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:59:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-71e2eadf-2532-4233-92ab-2ddfffb100c9 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.447s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG nova.network.neutron [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d6d2fbe0-8cec-4cab-8f6a-c3ad2a1140e4 req-b01cda59-0d22-46e8-8cbd-cc383e50563a service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: 6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 13:59:58 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-7c5501c3-504c-43c3-8754-e4b9df6c5d65. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port 7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 13:59:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Successfully updated port: dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:00 user nova-compute[74582]: INFO nova.compute.manager [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Detaching volume 12effdff-ef3d-4606-af2a-6723cc009a0b
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:00 user nova-compute[74582]: INFO nova.virt.block_device [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attempting to driver detach volume 12effdff-ef3d-4606-af2a-6723cc009a0b from mountpoint /dev/vdb
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Attempting to detach device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:00:00 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:00:00 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:00:00 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:00:00 user nova-compute[74582]:   <serial>12effdff-ef3d-4606-af2a-6723cc009a0b</serial>
Nov 03 14:00:00 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:00:00 user nova-compute[74582]: </disk>
Nov 03 14:00:00 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:00:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config.
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:00:00 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:00:00 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:00:00 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:00:00 user nova-compute[74582]:   <serial>12effdff-ef3d-4606-af2a-6723cc009a0b</serial>
Nov 03 14:00:00 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:00:00 user nova-compute[74582]: </disk>
Nov 03 14:00:00 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-6f37f7eb-7132-4cc3-b637-8a5e027640ed. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port 6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-b598b89e-341e-42f2-9a02-1cbfc77be2e6. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4ed8f0ba-56d2-4f46-93d0-4cade4a54aaf req-5912a027-8370-4c7c-a4b9-75a04d6e8b3f service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-dfd9e781-9ccb-4b3c-966d-592423a7c189. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:00:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7785MB free_disk=25.246383666992188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d9bac93a-31ea-411d-868a-0afb4ff56880 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b896be38-f944-448e-8f0c-2ff49fb396a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance defe453f-2cfb-43e0-9e1f-9f5223258982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bfd1deec-6150-47c0-b319-02754d07e077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9e9b61ac-1001-4da7-8478-7c5665ad112a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:00:02 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG os_brick.utils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e0d29-3e3f-47e7-a618-edd8e3379b64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7512a36c-24e0-45e5-90cd-13382f4b594c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e37a9-ecdf-4e41-a76d-ccd69952c084]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14d0d49-3d9b-4ae2-b288-2220ddef3bea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:03 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a62d99-e05e-4d14-9dd6-caec48d225e9]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG os_brick.utils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating existing volume attachment record: c933e17a-b609-4749-914d-107589675c8d {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [{"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance network_info: |[{"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:00:03 user nova-compute[74582]: DEBUG nova.network.neutron [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:00:04 user nova-compute[74582]: DEBUG nova.network.neutron [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updated VIF entry in instance network info cache for port dfd9e781-9ccb-4b3c-966d-592423a7c189. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:00:04 user nova-compute[74582]: DEBUG nova.network.neutron [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [{"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4289986e-3cd2-45d2-bcc6-f3a65607a86b req-185d01fe-e27c-46b8-93bd-799c212e0334 service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:12 user nova-compute[74582]: INFO nova.virt.block_device [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Booting with volume 375901e6-0fd5-4505-a67e-70d55d3855f7 at /dev/vdb
Nov 03 14:00:12 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2332075-e0fb-4c10-8cb4-24890a1cde20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[74457b90-8ef9-45ba-95a3-06e8001c72b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0af3ac1-64c8-40d4-b2e5-a6445a009888]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d859e99c-8b2e-4af0-95b4-0d80d7ae9108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:12 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:00:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9786d-e679-4c0d-a53f-bd2f7af355f3]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:00:12 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating existing volume attachment record: 9f3c28ff-5272-4d66-93d2-565cfbc8e60d {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:00:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 is timed out.
Nov 03 14:00:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config.
Nov 03 14:00:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtcljRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:00:20 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a0f44-aacb-4e7d-aea7-f6e39149b4f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:00:20 user nova-compute[74582]: No targets found.
Nov 03 14:00:20 user nova-compute[74582]: iSNS:
Nov 03 14:00:20 user nova-compute[74582]: No targets found.
Nov 03 14:00:20 user nova-compute[74582]: STATIC:
Nov 03 14:00:20 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b
Nov 03 14:00:20 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:00:20 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:00:20 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:00:20 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:00:20 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:00:20 user nova-compute[74582]: FIRMWARE:
Nov 03 14:00:20 user nova-compute[74582]: No targets found.
Nov 03 14:00:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:00:20 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:00:20 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3438395-f53b-4c21-95e7-eadb9450a96c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7468b-c755-4a3c-aa9c-c6587d405cbd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:00:20 user nova-compute[74582]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b (non-flash)
Nov 03 14:00:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:00:20 user nova-compute[74582]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b (non-flash)
Nov 03 14:00:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682d24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:00:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c9a03-57e6-4f21-a2bc-6adb279ba369]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dea5cd-59bf-4775-97bf-0cac56c427f2]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d052d9f-89e9-41b4-86b4-fcf5cbb03afe]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8574a-c094-4e7e-8f88-57935eec1b37]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6f85f2-dc8b-4177-805b-ca656ef2ed1e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34421a4-8ba8-4abe-8b90-a5e20123b61d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260]
Nov 03 14:00:21 user nova-compute[74582]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b, portal: 172.16.0.220,3260] successful.
Nov 03 14:00:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12effdff-ef3d-4606-af2a-6723cc009a0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59e8663-f4a2-478b-a49b-8fd4abcdeeee]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== disconnect_volume: return (313ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:00:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:00:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:00:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1a86ab16-bf49-4efc-823b-dd5e6608eb65 tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.063s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:00:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Creating image(s)
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Ensure instance console log exists: /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Start _get_guest_xml network_info=[{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c933e17a-b609-4749-914d-107589675c8d', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfd1deec-6150-47c0-b319-02754d07e077', 'attached_at': '', 'detached_at': '', 'volume_id': '5f07ed50-ba1f-4e30-b3fd-83130e932411', 'serial': '5f07ed50-ba1f-4e30-b3fd-83130e932411'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:00:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:00:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:00:24 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:00:24 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:00:24 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[409db1a8-6fdd-453b-9d1a-2e5fb6c82cb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:00:24 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f595e160-5903-4657-9105-336beff86d56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411] added
Nov 03 14:00:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15fb83-30d6-4803-b0fa-fd32a92cf374]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5d44c-1adb-4bd4-84b9-86d58aefa2d6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuJgmTrY {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuJgmTrY" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c8b33-93bb-465a-9f4c-39ff3ac7fb5f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuJgmTrY'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c1db7b-1236-4d30-a23d-f47255585467]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fc87dc-cda4-411c-8554-fecbb97444f2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:00:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:00:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbe7610-e179-4e8c-a8cb-2a8e1c22d480]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260]
Nov 03 14:00:24 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260] successful.
Nov 03 14:00:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff4804-3aa2-4a8e-8da1-21574c95fc79]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dceaa8e-212a-43f2-b5d7-976db949c630]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:00:24 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:00:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:00:24 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:00:24 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4895d5a1-245c-46d3-a608-aeb63f37ec1f]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:00:24 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23066336661653531', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066336661653531', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-359675837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-359675837',id=26,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-fg3n5osw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:42Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=bfd1deec-6150-47c0-b319-02754d07e077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'pci_devices' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:00:25 user nova-compute[74582]:   <uuid>bfd1deec-6150-47c0-b319-02754d07e077</uuid>
Nov 03 14:00:25 user nova-compute[74582]:   <name>instance-0000001a</name>
Nov 03 14:00:25 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:00:25 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:00:25 user nova-compute[74582]:   <metadata>
Nov 03 14:00:25 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:00:25 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:00:25 user nova-compute[74582]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-359675837</nova:name>
Nov 03 14:00:25 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:00:24</nova:creationTime>
Nov 03 14:00:25 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:00:25 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:00:25 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:00:25 user nova-compute[74582]:       <nova:owner>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:user uuid="e900eb8f4f6548f183010bc08a3c66f4">tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member</nova:user>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:project uuid="7bc44a2fb46b4a649544d7e506a2d96b">tempest-ServerBootFromVolumeStableRescueTest-412298968</nova:project>
Nov 03 14:00:25 user nova-compute[74582]:       </nova:owner>
Nov 03 14:00:25 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:00:25 user nova-compute[74582]:       <nova:ports>
Nov 03 14:00:25 user nova-compute[74582]:         <nova:port uuid="8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93">
Nov 03 14:00:25 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 14:00:25 user nova-compute[74582]:         </nova:port>
Nov 03 14:00:25 user nova-compute[74582]:       </nova:ports>
Nov 03 14:00:25 user nova-compute[74582]:     </nova:instance>
Nov 03 14:00:25 user nova-compute[74582]:   </metadata>
Nov 03 14:00:25 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:00:25 user nova-compute[74582]:     <system>
Nov 03 14:00:25 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:00:25 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:00:25 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:00:25 user nova-compute[74582]:       <entry name="serial">bfd1deec-6150-47c0-b319-02754d07e077</entry>
Nov 03 14:00:25 user nova-compute[74582]:       <entry name="uuid">bfd1deec-6150-47c0-b319-02754d07e077</entry>
Nov 03 14:00:25 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:00:25 user nova-compute[74582]:     </system>
Nov 03 14:00:25 user nova-compute[74582]:   </sysinfo>
Nov 03 14:00:25 user nova-compute[74582]:   <os>
Nov 03 14:00:25 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:00:25 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:00:25 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:00:25 user nova-compute[74582]:   </os>
Nov 03 14:00:25 user nova-compute[74582]:   <features>
Nov 03 14:00:25 user nova-compute[74582]:     <acpi/>
Nov 03 14:00:25 user nova-compute[74582]:     <apic/>
Nov 03 14:00:25 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:00:25 user nova-compute[74582]:   </features>
Nov 03 14:00:25 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:00:25 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:00:25 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:00:25 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:00:25 user nova-compute[74582]:   </clock>
Nov 03 14:00:25 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:00:25 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:00:25 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:00:25 user nova-compute[74582]:   </cpu>
Nov 03 14:00:25 user nova-compute[74582]:   <devices>
Nov 03 14:00:25 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:00:25 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:00:25 user nova-compute[74582]:       <source dev="/dev/sdc"/>
Nov 03 14:00:25 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:00:25 user nova-compute[74582]:       <serial>5f07ed50-ba1f-4e30-b3fd-83130e932411</serial>
Nov 03 14:00:25 user nova-compute[74582]:     </disk>
Nov 03 14:00:25 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:00:25 user nova-compute[74582]:       <mac address="fa:16:3e:21:04:f9"/>
Nov 03 14:00:25 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:00:25 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:00:25 user nova-compute[74582]:       <target dev="tap8ba4d9ec-1e"/>
Nov 03 14:00:25 user nova-compute[74582]:     </interface>
Nov 03 14:00:25 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:00:25 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/console.log" append="off"/>
Nov 03 14:00:25 user nova-compute[74582]:     </serial>
Nov 03 14:00:25 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:00:25 user nova-compute[74582]:     <video>
Nov 03 14:00:25 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:00:25 user nova-compute[74582]:     </video>
Nov 03 14:00:25 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:00:25 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:00:25 user nova-compute[74582]:     </rng>
Nov 03 14:00:25 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:00:25 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:00:25 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:00:25 user nova-compute[74582]:     </memballoon>
Nov 03 14:00:25 user nova-compute[74582]:   </devices>
Nov 03 14:00:25 user nova-compute[74582]: </domain>
Nov 03 14:00:25 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-359675837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-359675837',id=26,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-fg3n5osw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:42Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=bfd1deec-6150-47c0-b319-02754d07e077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG os_vif [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22bd21df-70be-5c74-aa20-8f1ad7ae931d', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ba4d9ec-1e, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ba4d9ec-1e, col_values=(('qos', UUID('570e59ec-6e62-43c6-98b8-7415e1220687')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ba4d9ec-1e, col_values=(('external_ids', {'iface-id': '8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:04:f9', 'vm-uuid': 'bfd1deec-6150-47c0-b319-02754d07e077'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:25 user nova-compute[74582]: INFO os_vif [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e')
Nov 03 14:00:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:00:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No VIF found with MAC fa:16:3e:21:04:f9, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-625766f1-536f-41f2-af4b-5168624d5807 req-d2387b8c-dd11-4104-9558-ab3e39c8901a service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-625766f1-536f-41f2-af4b-5168624d5807 req-d2387b8c-dd11-4104-9558-ab3e39c8901a service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-625766f1-536f-41f2-af4b-5168624d5807 req-d2387b8c-dd11-4104-9558-ab3e39c8901a service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-625766f1-536f-41f2-af4b-5168624d5807 req-d2387b8c-dd11-4104-9558-ab3e39c8901a service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-625766f1-536f-41f2-af4b-5168624d5807 req-d2387b8c-dd11-4104-9558-ab3e39c8901a service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:00:27 user nova-compute[74582]: WARNING nova.compute.manager [req-625766f1-536f-41f2-af4b-5168624d5807 req-d2387b8c-dd11-4104-9558-ab3e39c8901a service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state building and task_state spawning.
Nov 03 14:00:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-8c64c21f-ac40-4006-8972-05bf63e520a0 req-6e996262-ec04-4160-97ff-3f00469b619f service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8c64c21f-ac40-4006-8972-05bf63e520a0 req-6e996262-ec04-4160-97ff-3f00469b619f service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8c64c21f-ac40-4006-8972-05bf63e520a0 req-6e996262-ec04-4160-97ff-3f00469b619f service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8c64c21f-ac40-4006-8972-05bf63e520a0 req-6e996262-ec04-4160-97ff-3f00469b619f service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-8c64c21f-ac40-4006-8972-05bf63e520a0 req-6e996262-ec04-4160-97ff-3f00469b619f service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:00:29 user nova-compute[74582]: WARNING nova.compute.manager [req-8c64c21f-ac40-4006-8972-05bf63e520a0 req-6e996262-ec04-4160-97ff-3f00469b619f service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state building and task_state spawning.
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:00:29 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance spawned successfully.
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:00:29 user nova-compute[74582]: INFO nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 03 14:00:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:00:30 user nova-compute[74582]: INFO nova.compute.manager [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Took 48.91 seconds to build instance.
Nov 03 14:00:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a956f2b3-41ce-48a3-b4ce-e21a3cc057ca tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "bfd1deec-6150-47c0-b319-02754d07e077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.019s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:35 user nova-compute[74582]: INFO nova.virt.block_device [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Booting with volume b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 at /dev/vdc
Nov 03 14:00:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd41419-7725-4e3d-ae1d-7e59c21e4a05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d34eb-1fa5-4598-b6a3-5f51a0ddb99c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6246be8c-84c8-4726-b956-ddab3e105fa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e8d263-c471-4e4f-bae7-9c0d1e3b6e17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:35 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5704fa1-aefd-459e-8000-959acba1baf5]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating existing volume attachment record: 267d997d-9211-482d-9677-77eea186d07e {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:35 user nova-compute[74582]: INFO nova.compute.manager [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Terminating instance
Nov 03 14:00:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-63fac5a6-7b79-4908-98d6-5d50ddcc9dfb req-2b3c1c68-d404-4aed-8bb3-e06d27f13047 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-unplugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63fac5a6-7b79-4908-98d6-5d50ddcc9dfb req-2b3c1c68-d404-4aed-8bb3-e06d27f13047 service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63fac5a6-7b79-4908-98d6-5d50ddcc9dfb req-2b3c1c68-d404-4aed-8bb3-e06d27f13047 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63fac5a6-7b79-4908-98d6-5d50ddcc9dfb req-2b3c1c68-d404-4aed-8bb3-e06d27f13047 service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-63fac5a6-7b79-4908-98d6-5d50ddcc9dfb req-2b3c1c68-d404-4aed-8bb3-e06d27f13047 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-unplugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-63fac5a6-7b79-4908-98d6-5d50ddcc9dfb req-2b3c1c68-d404-4aed-8bb3-e06d27f13047 service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-unplugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:00:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Instance destroyed successfully.
Nov 03 14:00:36 user nova-compute[74582]: DEBUG nova.objects.instance [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lazy-loading 'resources' on Instance uuid d9bac93a-31ea-411d-868a-0afb4ff56880 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-502419754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-502419754',id=18,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbwD9gJs2yXcQqIFtwatq0hM5ER3YUvbIs0UFXyxEDym93nkGFlja9k2K82n/AvThRa46w8f06lOrGscGtpT3OwMB0tPSvkAtB+MdezDAYpTMxZCeZQS5gruMqCIHf9bQ==',key_name='tempest-keypair-954096694',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d4212d1484dd1b416342134f844e0',ramdisk_id='',reservation_id='r-2b67zupc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1103257092',owner_user_name='tempest-AttachVolumeShelveTestJSON-1103257092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2857caf27f24ebc895421391f498e01',uuid=d9bac93a-31ea-411d-868a-0afb4ff56880,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converting VIF {"id": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "address": "fa:16:3e:df:d8:bc", "network": {"id": "dec8eec5-ebf5-4662-a7f9-b186ca332811", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-983332847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d4212d1484dd1b416342134f844e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e2cdf8-b6", "ovs_interfaceid": "f2e2cdf8-b6d0-4d51-b766-518d8ac3915a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG os_vif [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2e2cdf8-b6, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0697fd7e-cad3-4db0-8508-88b28c32245b) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:36 user nova-compute[74582]: INFO os_vif [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2e2cdf8-b6d0-4d51-b766-518d8ac3915a,network=Network(dec8eec5-ebf5-4662-a7f9-b186ca332811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e2cdf8-b6')
Nov 03 14:00:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Deleting instance files /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880_del
Nov 03 14:00:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Deletion of /opt/stack/data/nova/instances/d9bac93a-31ea-411d-868a-0afb4ff56880_del complete
Nov 03 14:00:36 user nova-compute[74582]: INFO nova.compute.manager [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 03 14:00:36 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:00:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:37 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Took 1.04 seconds to deallocate network for instance.
Nov 03 14:00:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] Acquiring lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] No waiting events found dispatching network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:00:37 user nova-compute[74582]: WARNING nova.compute.manager [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received unexpected event network-vif-plugged-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a for instance with vm_state deleted and task_state None.
Nov 03 14:00:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-db9907b0-a63e-425c-9431-18161e025e57 req-4dbfccde-f1f9-4d6e-b792-247e0f352bea service nova] [instance: d9bac93a-31ea-411d-868a-0afb4ff56880] Received event network-vif-deleted-f2e2cdf8-b6d0-4d51-b766-518d8ac3915a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:38 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:00:38 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:00:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:38 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Deleted allocations for instance d9bac93a-31ea-411d-868a-0afb4ff56880
Nov 03 14:00:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-af1ffd64-ffeb-4bbd-a551-a3627c2b78d9 tempest-AttachVolumeShelveTestJSON-1103257092 tempest-AttachVolumeShelveTestJSON-1103257092-project-member] Lock "d9bac93a-31ea-411d-868a-0afb4ff56880" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-changed-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Refreshing instance network info cache due to event network-changed-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:00:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] Acquiring lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:00:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] Acquired lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:00:47 user nova-compute[74582]: DEBUG nova.network.neutron [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Refreshing network info cache for port ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-changed-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Refreshing instance network info cache due to event network-changed-5ef92fe0-5804-4f9d-9633-2130066b3030. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] Acquiring lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] Acquired lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Refreshing network info cache for port 5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updated VIF entry in instance network info cache for port ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updating instance_info_cache with network_info: [{"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ee68503d-5d01-478c-926c-7619b24375b9 req-d4a60dcf-648b-4850-a93a-28ca1f9236a6 service nova] Releasing lock "refresh_cache-b896be38-f944-448e-8f0c-2ff49fb396a8" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:49 user nova-compute[74582]: DEBUG nova.network.neutron [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updated VIF entry in instance network info cache for port 5ef92fe0-5804-4f9d-9633-2130066b3030. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:00:49 user nova-compute[74582]: DEBUG nova.network.neutron [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updating instance_info_cache with network_info: [{"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:00:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-87b9d73e-276f-4cac-a6cd-ddd861e9473e req-1028e94e-280c-4cfd-9001-a1fc490eba58 service nova] Releasing lock "refresh_cache-defe453f-2cfb-43e0-9e1f-9f5223258982" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:00:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:54 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid b896be38-f944-448e-8f0c-2ff49fb396a8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:00:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:00:55 user nova-compute[74582]: INFO nova.compute.manager [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Attaching volume 9f51e9b4-2904-47bd-9d77-9406b2c20907 to /dev/vdb
Nov 03 14:00:55 user nova-compute[74582]: DEBUG os_brick.utils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c54349-9edc-4951-9f97-c801e3747610]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c0c092-e189-4661-ab28-87bc0520f03f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c576ec-93e0-444e-8cdb-20e0a2e9b15d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23eecf-d77e-45eb-8983-d97258967e43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:00:55 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:00:55 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade6607-2ae9-4a07-ba0d-d5a5fdee2031]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG os_brick.utils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:00:55 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updating existing volume attachment record: 2e865674-2f0f-4c43-8507-b028540112e9 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:00:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:00:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:00 user nova-compute[74582]: INFO nova.compute.manager [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attaching volume fc5d15b9-202d-4fce-b763-2e6e297152f0 to /dev/vdb
Nov 03 14:01:00 user nova-compute[74582]: DEBUG os_brick.utils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b37fcc-8258-4c2f-bb95-ed392191bf72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e9ce1c-54e6-4e41-a0f1-eb0baf69485c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[47df8d0f-e1e8-4d10-a119-ecfb3ff2ccf8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8457ac8-5f81-4ad3-a7de-a80ff151406e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:01:00 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:01:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0ed09b-a59f-4246-9169-27306f720b94]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG os_brick.utils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:00 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updating existing volume attachment record: a7b04ce6-254a-4739-8205-346711bd6d91 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:01:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:01:02 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Creating image(s)
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Ensure instance console log exists: /opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Start _get_guest_xml network_info=[{"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '862b2800-30e2-4dde-8734-c45d5cefd259', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ertoPSQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e9b61ac-1001-4da7-8478-7c5665ad112a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a966bf00-0eb1-41d2-8f70-659557240014', 'serial': 'a966bf00-0eb1-41d2-8f70-659557240014'}, 'volume_type': None}, {'attachment_id': '9f3c28ff-5272-4d66-93d2-565cfbc8e60d', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afcALlhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e9b61ac-1001-4da7-8478-7c5665ad112a', 'attached_at': '', 'detached_at': '', 'volume_id': '375901e6-0fd5-4505-a67e-70d55d3855f7', 'serial': '375901e6-0fd5-4505-a67e-70d55d3855f7'}, 'volume_type': None}, {'attachment_id': '267d997d-9211-482d-9677-77eea186d07e', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YobVnKHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e9b61ac-1001-4da7-8478-7c5665ad112a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79', 'serial': 'b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:01:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:01:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ertoPSQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:02 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:02 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:02 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea646d-e150-4da1-a95d-543cf385e027]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:01:02 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee62d533-b732-466a-bb32-9ff68164f21b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014] added
Nov 03 14:01:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[91489957-9e03-4f5b-bc6a-0689b8efc22f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e652457a-6076-4cd0-89b3-1414ce6ed49b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ertoPSQI {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ertoPSQI" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[501286bc-4f77-4883-ad03-b5bbc4f20b13]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ertoPSQI'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11255564-c9ef-4f0a-b6b5-8798df2bf92c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df683f7-4c43-4574-aee6-b2054bcf1606]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd3caf1-ba93-4757-926e-58f8c88dc216]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260]
Nov 03 14:01:02 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260] successful.
Nov 03 14:01:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4ee31a-29ed-494c-9a16-d0d5168b55c7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ecd52a-b6f9-44dc-b535-59da3228352f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[04474c81-90ba-42df-8a6a-38e432e88da2]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ertoPSQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23965376265363430', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376265363430', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afcALlhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:03 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016a7d0-a7ef-4556-85cd-0c8f438b9431]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:01:03 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f5181-29b7-4def-91d9-98b94e95de55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7] added
Nov 03 14:01:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfee418-22ff-40bf-99b7-991fd2a24c63]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740bbb8-ab42-47d0-8ee8-466136eb637e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afcALlhX {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afcALlhX" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[302adece-239a-48e7-ba25-50c552196b74]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afcALlhX'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b34120-b546-4b00-8508-16e5a004f353]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[90832f35-16df-4687-8e4c-5300d01a4209]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0313e2-2ec7-482b-8f9f-31692fcc943d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260]
Nov 03 14:01:03 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260] successful.
Nov 03 14:01:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dedd00-9529-462e-bd91-167e70539755]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[461183f3-b757-4f78-8386-3739f00c28b1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:01:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.101s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a131b7de-52e2-406f-bcff-35ef673cf9be]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afcALlhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:04 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26664346664303239', 'path': '/dev/sde'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664346664303239', 'path': '/dev/sde'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YobVnKHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:05 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:05 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:05 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[723347b6-f5ff-429d-ac17-02428d3f3be9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:01:05 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527312a-5a9f-4ff7-9079-26480b7f4197]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79] added
Nov 03 14:01:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae8208b-312d-4d88-8283-bde4c952591a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba25f1-d1fc-4f81-888b-7fafac23dccd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YobVnKHO {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YobVnKHO" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83abb1b-3cb7-41d6-9cd2-93a7622cca04]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YobVnKHO'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef1461-3563-4152-a641-ddbcf388c7c0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4122ee-99a0-4c83-88d1-364ebc5219ed]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[52854010-b13e-4cb2-aa8b-ffbe243bcae6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260]
Nov 03 14:01:05 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260] successful.
Nov 03 14:01:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f362b8-9bae-4c5d-bdc6-7fd790214ac1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed896a7-1c7c-406c-b568-93d0fa9885e7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:05 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e24d9-39a0-4d91-b5d4-a6db4c90748d]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YobVnKHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23464633636326637', 'path': '/dev/sdf'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464633636326637', 'path': '/dev/sdf'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e9b61ac-1001-4da7-8478-7c5665ad112a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:01:06 user nova-compute[74582]:   <uuid>9e9b61ac-1001-4da7-8478-7c5665ad112a</uuid>
Nov 03 14:01:06 user nova-compute[74582]:   <name>instance-0000001b</name>
Nov 03 14:01:06 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:01:06 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:01:06 user nova-compute[74582]:   <metadata>
Nov 03 14:01:06 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:01:06 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:01:06 user nova-compute[74582]:       <nova:name>tempest-device-tagging-server-1137958868</nova:name>
Nov 03 14:01:06 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:01:02</nova:creationTime>
Nov 03 14:01:06 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:01:06 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:01:06 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:01:06 user nova-compute[74582]:       <nova:owner>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:user uuid="545e5fce790547b8913e2a83ae1a1008">tempest-TaggedBootDevicesTest_v242-125788020-project-member</nova:user>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:project uuid="08aee9ee017e4336b09fd4bb71033d37">tempest-TaggedBootDevicesTest_v242-125788020</nova:project>
Nov 03 14:01:06 user nova-compute[74582]:       </nova:owner>
Nov 03 14:01:06 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:01:06 user nova-compute[74582]:       <nova:ports>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="ee122f85-2da5-48e8-9c09-8df2a931bad2">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="f0ecf951-377c-4180-a575-8c9a3d3f8cc1">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="560214e5-1c3e-42e9-a466-bd14a9f9dc7f">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="7c5501c3-504c-43c3-8754-e4b9df6c5d65">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="6f37f7eb-7132-4cc3-b637-8a5e027640ed">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="b598b89e-341e-42f2-9a02-1cbfc77be2e6">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:         <nova:port uuid="dfd9e781-9ccb-4b3c-966d-592423a7c189">
Nov 03 14:01:06 user nova-compute[74582]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 14:01:06 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:06 user nova-compute[74582]:       </nova:ports>
Nov 03 14:01:06 user nova-compute[74582]:     </nova:instance>
Nov 03 14:01:06 user nova-compute[74582]:   </metadata>
Nov 03 14:01:06 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:01:06 user nova-compute[74582]:     <system>
Nov 03 14:01:06 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:01:06 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:01:06 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:01:06 user nova-compute[74582]:       <entry name="serial">9e9b61ac-1001-4da7-8478-7c5665ad112a</entry>
Nov 03 14:01:06 user nova-compute[74582]:       <entry name="uuid">9e9b61ac-1001-4da7-8478-7c5665ad112a</entry>
Nov 03 14:01:06 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:01:06 user nova-compute[74582]:     </system>
Nov 03 14:01:06 user nova-compute[74582]:   </sysinfo>
Nov 03 14:01:06 user nova-compute[74582]:   <os>
Nov 03 14:01:06 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:01:06 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:01:06 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:01:06 user nova-compute[74582]:   </os>
Nov 03 14:01:06 user nova-compute[74582]:   <features>
Nov 03 14:01:06 user nova-compute[74582]:     <acpi/>
Nov 03 14:01:06 user nova-compute[74582]:     <apic/>
Nov 03 14:01:06 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:01:06 user nova-compute[74582]:   </features>
Nov 03 14:01:06 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:01:06 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:01:06 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:01:06 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:01:06 user nova-compute[74582]:   </clock>
Nov 03 14:01:06 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:01:06 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:01:06 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:01:06 user nova-compute[74582]:   </cpu>
Nov 03 14:01:06 user nova-compute[74582]:   <devices>
Nov 03 14:01:06 user nova-compute[74582]:     <disk type="file" device="cdrom">
Nov 03 14:01:06 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 14:01:06 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a/disk.config"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="hda" bus="ide"/>
Nov 03 14:01:06 user nova-compute[74582]:     </disk>
Nov 03 14:01:06 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:01:06 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:06 user nova-compute[74582]:       <source dev="/dev/sdd"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <serial>a966bf00-0eb1-41d2-8f70-659557240014</serial>
Nov 03 14:01:06 user nova-compute[74582]:     </disk>
Nov 03 14:01:06 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:01:06 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:06 user nova-compute[74582]:       <source dev="/dev/sde"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <serial>375901e6-0fd5-4505-a67e-70d55d3855f7</serial>
Nov 03 14:01:06 user nova-compute[74582]:     </disk>
Nov 03 14:01:06 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:01:06 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:06 user nova-compute[74582]:       <source dev="/dev/sdf"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="vdc" bus="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <serial>b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79</serial>
Nov 03 14:01:06 user nova-compute[74582]:     </disk>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:2a:57:5d"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tapee122f85-2d"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:05:9d:07"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tapf0ecf951-37"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:71:7c:a0"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tap560214e5-1c"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:4d:15:6e"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tap7c5501c3-50"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:0c:b7:87"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tap6f37f7eb-71"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:cb:b5:57"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tapb598b89e-34"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:06 user nova-compute[74582]:       <mac address="fa:16:3e:cb:e7:dc"/>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:06 user nova-compute[74582]:       <target dev="tapdfd9e781-9c"/>
Nov 03 14:01:06 user nova-compute[74582]:     </interface>
Nov 03 14:01:06 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:01:06 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a/console.log" append="off"/>
Nov 03 14:01:06 user nova-compute[74582]:     </serial>
Nov 03 14:01:06 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:01:06 user nova-compute[74582]:     <video>
Nov 03 14:01:06 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:06 user nova-compute[74582]:     </video>
Nov 03 14:01:06 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:01:06 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:01:06 user nova-compute[74582]:     </rng>
Nov 03 14:01:06 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:01:06 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:01:06 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:01:06 user nova-compute[74582]:     </memballoon>
Nov 03 14:01:06 user nova-compute[74582]:   </devices>
Nov 03 14:01:06 user nova-compute[74582]: </domain>
Nov 03 14:01:06 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99a21652-4dd9-5a15-8c59-ff676c5f78f6', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee122f85-2d, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee122f85-2d, col_values=(('qos', UUID('bae3332e-b666-4bd9-a937-77dc50f2c102')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee122f85-2d, col_values=(('external_ids', {'iface-id': 'ee122f85-2da5-48e8-9c09-8df2a931bad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:57:5d', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d')
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9484f72-706b-52d2-a9eb-497cd8e58d01', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:01:07 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7855MB free_disk=25.26046371459961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0ecf951-37, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0ecf951-37, col_values=(('qos', UUID('aca829d1-45f4-4cde-8ac1-7cd070ad79c8')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0ecf951-37, col_values=(('external_ids', {'iface-id': 'f0ecf951-377c-4180-a575-8c9a3d3f8cc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9d:07', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37')
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d46b1d4-66cc-5c58-9e4d-65958474bd91', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap560214e5-1c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap560214e5-1c, col_values=(('qos', UUID('a4c56584-0236-42c1-a5dd-94c840d64c4b')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap560214e5-1c, col_values=(('external_ids', {'iface-id': '560214e5-1c3e-42e9-a466-bd14a9f9dc7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:7c:a0', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c')
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94547e23-23ab-5e44-9b6d-2fcc350dc7bb', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c5501c3-50, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c5501c3-50, col_values=(('qos', UUID('de95c7fe-82d1-4996-9f0c-1451c5a0a26c')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c5501c3-50, col_values=(('external_ids', {'iface-id': '7c5501c3-504c-43c3-8754-e4b9df6c5d65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:15:6e', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b896be38-f944-448e-8f0c-2ff49fb396a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance defe453f-2cfb-43e0-9e1f-9f5223258982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bfd1deec-6150-47c0-b319-02754d07e077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9e9b61ac-1001-4da7-8478-7c5665ad112a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50')
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b419b0da-ce77-512b-9ce7-ce95d3c520f7', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f37f7eb-71, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f37f7eb-71, col_values=(('qos', UUID('1bba3f62-7915-4529-ba6c-8764d28089d6')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f37f7eb-71, col_values=(('external_ids', {'iface-id': '6f37f7eb-7132-4cc3-b637-8a5e027640ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:b7:87', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71')
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '601fee34-f6dc-54f4-81a6-47f9412d35c6', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb598b89e-34, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb598b89e-34, col_values=(('qos', UUID('b2648353-35fe-4aa2-8ab5-f35ba7ea9d65')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb598b89e-34, col_values=(('external_ids', {'iface-id': 'b598b89e-341e-42f2-9a02-1cbfc77be2e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:b5:57', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34')
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T13:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88ad7c38-dff4-551d-967d-5d77083969bf', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfd9e781-9c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfd9e781-9c, col_values=(('qos', UUID('9ca53cb7-f908-4a36-99e8-4c25c8da2221')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfd9e781-9c, col_values=(('external_ids', {'iface-id': 'dfd9e781-9ccb-4b3c-966d-592423a7c189', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e7:dc', 'vm-uuid': '9e9b61ac-1001-4da7-8478-7c5665ad112a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:07 user nova-compute[74582]: INFO os_vif [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c')
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] No BDM found with device name hda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] No VIF found with MAC fa:16:3e:2a:57:5d, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:01:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] No VIF found with MAC fa:16:3e:0c:b7:87, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:01:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Using config drive
Nov 03 14:01:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Creating config drive at /opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a/disk.config
Nov 03 14:01:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsya9punw {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsya9punw" returned: 0 in 0.087s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.398s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:10 user nova-compute[74582]: INFO nova.compute.manager [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attaching volume 3c486f8c-6863-4569-a54f-7d0286cf5984 to /dev/vdb
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-590845a6-4cbf-4f1a-a2d5-752b2b0e818f req-4aa8ff80-2b69-4e9f-880b-751a462d4497 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-590845a6-4cbf-4f1a-a2d5-752b2b0e818f req-4aa8ff80-2b69-4e9f-880b-751a462d4497 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-590845a6-4cbf-4f1a-a2d5-752b2b0e818f req-4aa8ff80-2b69-4e9f-880b-751a462d4497 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-590845a6-4cbf-4f1a-a2d5-752b2b0e818f req-4aa8ff80-2b69-4e9f-880b-751a462d4497 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-590845a6-4cbf-4f1a-a2d5-752b2b0e818f req-4aa8ff80-2b69-4e9f-880b-751a462d4497 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:10 user nova-compute[74582]: WARNING nova.compute.manager [req-590845a6-4cbf-4f1a-a2d5-752b2b0e818f req-4aa8ff80-2b69-4e9f-880b-751a462d4497 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 for instance with vm_state building and task_state spawning.
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG os_brick.utils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d3e7e-7c54-418d-bc30-9ee1346f5e25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe43cf-bc87-4ca1-a021-749e0a9eaa70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e7c712-5269-4642-99f0-1abee8f79a17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49e73d-f12a-473c-be09-b9db53d244f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:01:10 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:01:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe346a-4048-4e98-a846-fb7e61145084]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG os_brick.utils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating existing volume attachment record: f6d0f365-d37a-4062-8e29-bf655c4242ae {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-ba3a72be-d1d5-4880-ab8f-805dfd6b66cd req-ce981e63-0a34-4cc0-b6f4-c1a628973149 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ba3a72be-d1d5-4880-ab8f-805dfd6b66cd req-ce981e63-0a34-4cc0-b6f4-c1a628973149 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ba3a72be-d1d5-4880-ab8f-805dfd6b66cd req-ce981e63-0a34-4cc0-b6f4-c1a628973149 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ba3a72be-d1d5-4880-ab8f-805dfd6b66cd req-ce981e63-0a34-4cc0-b6f4-c1a628973149 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-ba3a72be-d1d5-4880-ab8f-805dfd6b66cd req-ce981e63-0a34-4cc0-b6f4-c1a628973149 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:11 user nova-compute[74582]: WARNING nova.compute.manager [req-ba3a72be-d1d5-4880-ab8f-805dfd6b66cd req-ce981e63-0a34-4cc0-b6f4-c1a628973149 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 for instance with vm_state building and task_state spawning.
Nov 03 14:01:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-c05278ae-7bd7-4199-95b3-71bf4e41f6ad req-a5acd8f7-407e-4cf8-9ca5-f052c6c9bdb6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c05278ae-7bd7-4199-95b3-71bf4e41f6ad req-a5acd8f7-407e-4cf8-9ca5-f052c6c9bdb6 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c05278ae-7bd7-4199-95b3-71bf4e41f6ad req-a5acd8f7-407e-4cf8-9ca5-f052c6c9bdb6 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c05278ae-7bd7-4199-95b3-71bf4e41f6ad req-a5acd8f7-407e-4cf8-9ca5-f052c6c9bdb6 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-c05278ae-7bd7-4199-95b3-71bf4e41f6ad req-a5acd8f7-407e-4cf8-9ca5-f052c6c9bdb6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:11 user nova-compute[74582]: WARNING nova.compute.manager [req-c05278ae-7bd7-4199-95b3-71bf4e41f6ad req-a5acd8f7-407e-4cf8-9ca5-f052c6c9bdb6 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed for instance with vm_state building and task_state spawning.
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:12 user nova-compute[74582]: WARNING nova.compute.manager [req-e4dea5de-6320-44aa-bbb1-ae2e472e822f req-31e8e852-0f7a-440b-a5b3-70dca8f439c5 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 for instance with vm_state building and task_state spawning.
Nov 03 14:01:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-22429575-9786-4211-b812-25ed2b885fe8 req-0c4a4b1e-9822-4b15-a458-8ae92548b8ee service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-22429575-9786-4211-b812-25ed2b885fe8 req-0c4a4b1e-9822-4b15-a458-8ae92548b8ee service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-22429575-9786-4211-b812-25ed2b885fe8 req-0c4a4b1e-9822-4b15-a458-8ae92548b8ee service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-22429575-9786-4211-b812-25ed2b885fe8 req-0c4a4b1e-9822-4b15-a458-8ae92548b8ee service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-22429575-9786-4211-b812-25ed2b885fe8 req-0c4a4b1e-9822-4b15-a458-8ae92548b8ee service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:13 user nova-compute[74582]: WARNING nova.compute.manager [req-22429575-9786-4211-b812-25ed2b885fe8 req-0c4a4b1e-9822-4b15-a458-8ae92548b8ee service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 for instance with vm_state building and task_state spawning.
Nov 03 14:01:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-d26931fb-8b2f-4a15-b1fe-9e42c307c0a0 req-de34c319-a726-4d7d-b007-d8d9f5116f86 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d26931fb-8b2f-4a15-b1fe-9e42c307c0a0 req-de34c319-a726-4d7d-b007-d8d9f5116f86 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d26931fb-8b2f-4a15-b1fe-9e42c307c0a0 req-de34c319-a726-4d7d-b007-d8d9f5116f86 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d26931fb-8b2f-4a15-b1fe-9e42c307c0a0 req-de34c319-a726-4d7d-b007-d8d9f5116f86 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-d26931fb-8b2f-4a15-b1fe-9e42c307c0a0 req-de34c319-a726-4d7d-b007-d8d9f5116f86 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:13 user nova-compute[74582]: WARNING nova.compute.manager [req-d26931fb-8b2f-4a15-b1fe-9e42c307c0a0 req-de34c319-a726-4d7d-b007-d8d9f5116f86 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed for instance with vm_state building and task_state spawning.
Nov 03 14:01:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:01:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance spawned successfully.
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:14 user nova-compute[74582]: WARNING nova.compute.manager [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 for instance with vm_state building and task_state spawning.
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:14 user nova-compute[74582]: WARNING nova.compute.manager [req-b2cf9034-6fea-408a-8b02-0b8bb5b68f75 req-bc9e86bb-ac03-41b3-a785-d105536f1654 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 for instance with vm_state building and task_state spawning.
Nov 03 14:01:14 user nova-compute[74582]: INFO nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Took 12.55 seconds to spawn the instance on the hypervisor.
Nov 03 14:01:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:01:14 user nova-compute[74582]: INFO nova.compute.manager [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Took 84.34 seconds to build instance.
Nov 03 14:01:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bbab5a5-3176-4556-a536-a17cee47eccc tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 84.466s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIdwipfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:20 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:20 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:20 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8639a34a-7607-48b1-89a9-e680d26755cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:01:20 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9812b829-452a-4a56-96c6-49c4aa989715]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907] added
Nov 03 14:01:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0264bd87-7899-4c19-ac1c-3a238465b8e2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15756a4f-01c4-4568-8974-9d64fc027fdd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIdwipfJ {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIdwipfJ" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec8329-7817-49a2-a627-c1be25a48c69]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIdwipfJ'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e78d145-ab2c-47f0-ac46-690674e4d6fb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e0145-514e-474a-96ea-bea3586683bb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb08984a-5f52-460c-a42b-faf0424d6077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260]
Nov 03 14:01:20 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260] successful.
Nov 03 14:01:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[797a7e82-e48f-45e5-85aa-70cc6eb0fc6c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f96721-651a-462e-b110-a9259ad7dadd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)
Nov 03 14:01:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:01:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.046s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98d358-0aae-4542-b0b7-b99462a3fbf7]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:01:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIdwipfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:01:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23634393839316665', 'path': '/dev/sdg'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634393839316665', 'path': '/dev/sdg'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid b896be38-f944-448e-8f0c-2ff49fb396a8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:01:22 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:22 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 14:01:22 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:01:22 user nova-compute[74582]:   <serial>9f51e9b4-2904-47bd-9d77-9406b2c20907</serial>
Nov 03 14:01:22 user nova-compute[74582]: </disk>
Nov 03 14:01:22 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] No VIF found with MAC fa:16:3e:53:85:ed, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7021f644-d153-41a8-8aa6-cf4feb15a234 tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.460s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:23 user nova-compute[74582]: INFO nova.compute.manager [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Detaching volume 9f51e9b4-2904-47bd-9d77-9406b2c20907
Nov 03 14:01:23 user nova-compute[74582]: INFO nova.virt.block_device [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Attempting to driver detach volume 9f51e9b4-2904-47bd-9d77-9406b2c20907 from mountpoint /dev/vdb
Nov 03 14:01:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Attempting to detach device vdb from instance b896be38-f944-448e-8f0c-2ff49fb396a8 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:01:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:01:23 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:23 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 14:01:23 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:01:23 user nova-compute[74582]:   <serial>9f51e9b4-2904-47bd-9d77-9406b2c20907</serial>
Nov 03 14:01:23 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:01:23 user nova-compute[74582]: </disk>
Nov 03 14:01:23 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:01:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully detached device vdb from instance b896be38-f944-448e-8f0c-2ff49fb396a8 from the persistent domain config.
Nov 03 14:01:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b896be38-f944-448e-8f0c-2ff49fb396a8 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:01:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:01:23 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:23 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 14:01:23 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:01:23 user nova-compute[74582]:   <serial>9f51e9b4-2904-47bd-9d77-9406b2c20907</serial>
Nov 03 14:01:23 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:01:23 user nova-compute[74582]: </disk>
Nov 03 14:01:23 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:01:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b896be38-f944-448e-8f0c-2ff49fb396a8 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:01:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:32 user nova-compute[74582]: INFO nova.compute.manager [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Rescuing
Nov 03 14:01:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:01:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating instance_info_cache with network_info: [{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-37031e0b-e1c7-4ee6-a61c-272a7f42a5a0 req-da2eac0f-5953-4da7-8680-6d6652c0ad28 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-37031e0b-e1c7-4ee6-a61c-272a7f42a5a0 req-da2eac0f-5953-4da7-8680-6d6652c0ad28 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-37031e0b-e1c7-4ee6-a61c-272a7f42a5a0 req-da2eac0f-5953-4da7-8680-6d6652c0ad28 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-37031e0b-e1c7-4ee6-a61c-272a7f42a5a0 req-da2eac0f-5953-4da7-8680-6d6652c0ad28 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-37031e0b-e1c7-4ee6-a61c-272a7f42a5a0 req-da2eac0f-5953-4da7-8680-6d6652c0ad28 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:33 user nova-compute[74582]: WARNING nova.compute.manager [req-37031e0b-e1c7-4ee6-a61c-272a7f42a5a0 req-da2eac0f-5953-4da7-8680-6d6652c0ad28 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state active and task_state rescuing.
Nov 03 14:01:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:34 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance destroyed successfully.
Nov 03 14:01:34 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Attempting a stable device rescue
Nov 03 14:01:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74582) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 14:01:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 14:01:34 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Creating image(s)
Nov 03 14:01:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "/opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:34 user nova-compute[74582]: DEBUG nova.objects.instance [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'trusted_certs' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "21276b90bb5c92537dcd8912e010c4caea50213d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "21276b90bb5c92537dcd8912e010c4caea50213d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6b17459-ddda-4925-a998-cab5cd0290f0 req-9fd08e9a-d8be-4c25-96d7-dc2391a075c3 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6b17459-ddda-4925-a998-cab5cd0290f0 req-9fd08e9a-d8be-4c25-96d7-dc2391a075c3 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6b17459-ddda-4925-a998-cab5cd0290f0 req-9fd08e9a-d8be-4c25-96d7-dc2391a075c3 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6b17459-ddda-4925-a998-cab5cd0290f0 req-9fd08e9a-d8be-4c25-96d7-dc2391a075c3 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6b17459-ddda-4925-a998-cab5cd0290f0 req-9fd08e9a-d8be-4c25-96d7-dc2391a075c3 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:36 user nova-compute[74582]: WARNING nova.compute.manager [req-e6b17459-ddda-4925-a998-cab5cd0290f0 req-9fd08e9a-d8be-4c25-96d7-dc2391a075c3 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state active and task_state rescuing.
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.part --force-share --output=json" returned: 0 in 0.232s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG nova.virt.images [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] eca37c23-fa41-4068-8e2e-a06b3a391b89 was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.part /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.part /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.converted" returned: 0 in 0.478s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "21276b90bb5c92537dcd8912e010c4caea50213d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.189s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "21276b90bb5c92537dcd8912e010c4caea50213d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "21276b90bb5c92537dcd8912e010c4caea50213d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d,backing_fmt=raw /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d,backing_fmt=raw /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue" returned: 0 in 0.049s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "21276b90bb5c92537dcd8912e010c4caea50213d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'migration_context' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<bfd1deec-6150-47c0-b319-02754d07e077> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Start _get_guest_xml network_info=[{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "vif_mac": "fa:16:3e:21:04:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eca37c23-fa41-4068-8e2e-a06b3a391b89', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c933e17a-b609-4749-914d-107589675c8d', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'bfd1deec-6150-47c0-b319-02754d07e077', 'attached_at': '', 'detached_at': '', 'volume_id': '5f07ed50-ba1f-4e30-b3fd-83130e932411', 'serial': '5f07ed50-ba1f-4e30-b3fd-83130e932411'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'resources' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<bfd1deec-6150-47c0-b319-02754d07e077> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'numa_topology' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<bfd1deec-6150-47c0-b319-02754d07e077> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:01:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:01:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'vcpu_model' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<bfd1deec-6150-47c0-b319-02754d07e077> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:37 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:37 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:37 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478a523-338b-46ce-999d-7bf13fa049f3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PuJgmTrY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 14:01:37 user nova-compute[74582]: node.name = iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:01:37 user nova-compute[74582]: node.tpgt = -1
Nov 03 14:01:37 user nova-compute[74582]: node.startup = automatic
Nov 03 14:01:37 user nova-compute[74582]: node.leading_login = No
Nov 03 14:01:37 user nova-compute[74582]: iface.iscsi_ifacename = default
Nov 03 14:01:37 user nova-compute[74582]: iface.net_ifacename = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.ipaddress = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.prefix_len = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.hwaddress = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.transport_name = tcp
Nov 03 14:01:37 user nova-compute[74582]: iface.initiatorname = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.vlan_id = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.vlan_priority = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.vlan_state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.iface_num = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.mtu = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.port = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.bootproto = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.subnet_mask = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.gateway = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_alt_client_id = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_dns = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_learn_iqn = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_vendor_id_state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_vendor_id = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.dhcp_slp_da = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.fragmentation = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.gratuitous_arp = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.incoming_forwarding = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.tos_state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.tos = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.ttl = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.delayed_ack = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.tcp_nagle = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.tcp_wsf_state = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.tcp_wsf = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.tcp_timer_scale = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.tcp_timestamp = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.redirect = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.def_task_mgmt_timeout = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.header_digest = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.data_digest = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.immediate_data = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.initial_r2t = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.data_seq_inorder = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.data_pdu_inorder = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.erl = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.max_receive_data_len = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.first_burst_len = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.max_outstanding_r2t = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.max_burst_len = 0
Nov 03 14:01:37 user nova-compute[74582]: iface.chap_auth = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.bidi_chap = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.strict_login_compliance = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.discovery_auth = <empty>
Nov 03 14:01:37 user nova-compute[74582]: iface.discovery_logout = <empty>
Nov 03 14:01:37 user nova-compute[74582]: node.discovery_address = <empty>
Nov 03 14:01:37 user nova-compute[74582]: node.discovery_port = 0
Nov 03 14:01:37 user nova-compute[74582]: node.discovery_type = static
Nov 03 14:01:37 user nova-compute[74582]: node.session.initial_cmdsn = 0
Nov 03 14:01:37 user nova-compute[74582]: node.session.initial_login_retry_max = 8
Nov 03 14:01:37 user nova-compute[74582]: node.session.xmit_thread_priority = -20
Nov 03 14:01:37 user nova-compute[74582]: node.session.cmds_max = 128
Nov 03 14:01:37 user nova-compute[74582]: node.session.queue_depth = 32
Nov 03 14:01:37 user nova-compute[74582]: node.session.nr_sessions = 1
Nov 03 14:01:37 user nova-compute[74582]: node.session.auth.authmethod = CHAP
Nov 03 14:01:37 user nova-compute[74582]: node.session.auth.username = PuJgmTrY
Nov 03 14:01:37 user nova-compute[74582]: node.session.auth.password = ***
Nov 03 14:01:37 user nova-compute[74582]: node.session.auth.username_in = <empty>
Nov 03 14:01:37 user nova-compute[74582]: node.session.auth.password_in = <empty>
Nov 03 14:01:37 user nova-compute[74582]: node.session.auth.chap_algs = MD5
Nov 03 14:01:37 user nova-compute[74582]: node.session.timeo.replacement_timeout = 120
Nov 03 14:01:37 user nova-compute[74582]: node.session.err_timeo.abort_timeout = 15
Nov 03 14:01:37 user nova-compute[74582]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 14:01:37 user nova-compute[74582]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 14:01:37 user nova-compute[74582]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.FastAbort = Yes
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.InitialR2T = No
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.ImmediateData = Yes
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.MaxConnections = 1
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 14:01:37 user nova-compute[74582]: node.session.iscsi.ERL = 0
Nov 03 14:01:37 user nova-compute[74582]: node.session.scan = manual
Nov 03 14:01:37 user nova-compute[74582]: node.session.reopen_max = 0
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].address = 172.16.0.220
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].port = 3260
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].startup = manual
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].tcp.window_size = 524288
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].tcp.type_of_service = 0
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].timeo.logout_timeout = 15
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].timeo.login_timeout = 15
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].timeo.auth_timeout = 45
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].iscsi.DataDigest = None
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].iscsi.IFMarker = No
Nov 03 14:01:37 user nova-compute[74582]: node.conn[0].iscsi.OFMarker = No
Nov 03 14:01:37 user nova-compute[74582]: # END RECORD
Nov 03 14:01:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d875f-3e3b-4bb6-8da3-926610eab73a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6305ab17-e681-4102-bca0-ae5bac650e26]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuJgmTrY {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuJgmTrY" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a8349-9746-49f9-9001-39e2b6aa13b6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuJgmTrY'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba284d87-6b2e-42a7-9513-8e16e1be900f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[508014a6-d1af-4f3c-98ef-b246e5904785]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)
Nov 03 14:01:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa468a6-9af9-43c7-b349-0a7710d7a142]: (4, ('0 0 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23066336661653531', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066336661653531', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-359675837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-359675837',id=26,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-fg3n5osw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:00:30Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=bfd1deec-6150-47c0-b319-02754d07e077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "vif_mac": "fa:16:3e:21:04:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "vif_mac": "fa:16:3e:21:04:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'pci_devices' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.objects.base [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Object Instance<bfd1deec-6150-47c0-b319-02754d07e077> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:01:37 user nova-compute[74582]:   <uuid>bfd1deec-6150-47c0-b319-02754d07e077</uuid>
Nov 03 14:01:37 user nova-compute[74582]:   <name>instance-0000001a</name>
Nov 03 14:01:37 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:01:37 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:01:37 user nova-compute[74582]:   <metadata>
Nov 03 14:01:37 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:01:37 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:01:37 user nova-compute[74582]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-359675837</nova:name>
Nov 03 14:01:37 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:01:37</nova:creationTime>
Nov 03 14:01:37 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:01:37 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:01:37 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:01:37 user nova-compute[74582]:       <nova:owner>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:user uuid="e900eb8f4f6548f183010bc08a3c66f4">tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member</nova:user>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:project uuid="7bc44a2fb46b4a649544d7e506a2d96b">tempest-ServerBootFromVolumeStableRescueTest-412298968</nova:project>
Nov 03 14:01:37 user nova-compute[74582]:       </nova:owner>
Nov 03 14:01:37 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:01:37 user nova-compute[74582]:       <nova:ports>
Nov 03 14:01:37 user nova-compute[74582]:         <nova:port uuid="8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93">
Nov 03 14:01:37 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 14:01:37 user nova-compute[74582]:         </nova:port>
Nov 03 14:01:37 user nova-compute[74582]:       </nova:ports>
Nov 03 14:01:37 user nova-compute[74582]:     </nova:instance>
Nov 03 14:01:37 user nova-compute[74582]:   </metadata>
Nov 03 14:01:37 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:01:37 user nova-compute[74582]:     <system>
Nov 03 14:01:37 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:01:37 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:01:37 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:01:37 user nova-compute[74582]:       <entry name="serial">bfd1deec-6150-47c0-b319-02754d07e077</entry>
Nov 03 14:01:37 user nova-compute[74582]:       <entry name="uuid">bfd1deec-6150-47c0-b319-02754d07e077</entry>
Nov 03 14:01:37 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:01:37 user nova-compute[74582]:     </system>
Nov 03 14:01:37 user nova-compute[74582]:   </sysinfo>
Nov 03 14:01:37 user nova-compute[74582]:   <os>
Nov 03 14:01:37 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:01:37 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:01:37 user nova-compute[74582]:   </os>
Nov 03 14:01:37 user nova-compute[74582]:   <features>
Nov 03 14:01:37 user nova-compute[74582]:     <acpi/>
Nov 03 14:01:37 user nova-compute[74582]:     <apic/>
Nov 03 14:01:37 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:01:37 user nova-compute[74582]:   </features>
Nov 03 14:01:37 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:01:37 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:01:37 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:01:37 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:01:37 user nova-compute[74582]:   </clock>
Nov 03 14:01:37 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:01:37 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:01:37 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:01:37 user nova-compute[74582]:   </cpu>
Nov 03 14:01:37 user nova-compute[74582]:   <devices>
Nov 03 14:01:37 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:01:37 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:01:37 user nova-compute[74582]:       <source dev="/dev/sdc"/>
Nov 03 14:01:37 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:01:37 user nova-compute[74582]:       <serial>5f07ed50-ba1f-4e30-b3fd-83130e932411</serial>
Nov 03 14:01:37 user nova-compute[74582]:     </disk>
Nov 03 14:01:37 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:01:37 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:01:37 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue"/>
Nov 03 14:01:37 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:01:37 user nova-compute[74582]:       <boot order="1"/>
Nov 03 14:01:37 user nova-compute[74582]:     </disk>
Nov 03 14:01:37 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:01:37 user nova-compute[74582]:       <mac address="fa:16:3e:21:04:f9"/>
Nov 03 14:01:37 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:37 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:01:37 user nova-compute[74582]:       <target dev="tap8ba4d9ec-1e"/>
Nov 03 14:01:37 user nova-compute[74582]:     </interface>
Nov 03 14:01:37 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:01:37 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/console.log" append="off"/>
Nov 03 14:01:37 user nova-compute[74582]:     </serial>
Nov 03 14:01:37 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:01:37 user nova-compute[74582]:     <video>
Nov 03 14:01:37 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:01:37 user nova-compute[74582]:     </video>
Nov 03 14:01:37 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:01:37 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:01:37 user nova-compute[74582]:     </rng>
Nov 03 14:01:37 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:01:37 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:01:37 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:01:37 user nova-compute[74582]:     </memballoon>
Nov 03 14:01:37 user nova-compute[74582]:   </devices>
Nov 03 14:01:37 user nova-compute[74582]: </domain>
Nov 03 14:01:37 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:01:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance destroyed successfully.
Nov 03 14:01:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:01:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] No VIF found with MAC fa:16:3e:21:04:f9, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-c2665dac-bf6e-4d42-a52e-63b72f9b0204 req-7ea3be55-d2bc-48d0-9a8d-67f950746c6b service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c2665dac-bf6e-4d42-a52e-63b72f9b0204 req-7ea3be55-d2bc-48d0-9a8d-67f950746c6b service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c2665dac-bf6e-4d42-a52e-63b72f9b0204 req-7ea3be55-d2bc-48d0-9a8d-67f950746c6b service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c2665dac-bf6e-4d42-a52e-63b72f9b0204 req-7ea3be55-d2bc-48d0-9a8d-67f950746c6b service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-c2665dac-bf6e-4d42-a52e-63b72f9b0204 req-7ea3be55-d2bc-48d0-9a8d-67f950746c6b service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:39 user nova-compute[74582]: WARNING nova.compute.manager [req-c2665dac-bf6e-4d42-a52e-63b72f9b0204 req-7ea3be55-d2bc-48d0-9a8d-67f950746c6b service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state active and task_state rescuing.
Nov 03 14:01:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-c75fba0a-94b1-4ba9-83c8-994113ac0007 req-9fbb3c9f-e005-4d13-b05a-03a0a676455a service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c75fba0a-94b1-4ba9-83c8-994113ac0007 req-9fbb3c9f-e005-4d13-b05a-03a0a676455a service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c75fba0a-94b1-4ba9-83c8-994113ac0007 req-9fbb3c9f-e005-4d13-b05a-03a0a676455a service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c75fba0a-94b1-4ba9-83c8-994113ac0007 req-9fbb3c9f-e005-4d13-b05a-03a0a676455a service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-c75fba0a-94b1-4ba9-83c8-994113ac0007 req-9fbb3c9f-e005-4d13-b05a-03a0a676455a service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:01:41 user nova-compute[74582]: WARNING nova.compute.manager [req-c75fba0a-94b1-4ba9-83c8-994113ac0007 req-9fbb3c9f-e005-4d13-b05a-03a0a676455a service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state active and task_state rescuing.
Nov 03 14:01:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-be27accb-b4b1-4a43-a604-321d040b136f tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:01:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b896be38-f944-448e-8f0c-2ff49fb396a8 is timed out.
Nov 03 14:01:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully detached device vdb from instance b896be38-f944-448e-8f0c-2ff49fb396a8 from the live domain config.
Nov 03 14:01:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIdwipfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94bad1f-f383-4c83-93e0-eba001aeefea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:01:44 user nova-compute[74582]: No targets found.
Nov 03 14:01:44 user nova-compute[74582]: iSNS:
Nov 03 14:01:44 user nova-compute[74582]: No targets found.
Nov 03 14:01:44 user nova-compute[74582]: STATIC:
Nov 03 14:01:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907
Nov 03 14:01:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:01:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:01:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7
Nov 03 14:01:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:01:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:01:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014
Nov 03 14:01:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:01:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:01:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79
Nov 03 14:01:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:01:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:01:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:01:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:01:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:01:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:01:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:01:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:01:44 user nova-compute[74582]: FIRMWARE:
Nov 03 14:01:44 user nova-compute[74582]: No targets found.
Nov 03 14:01:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:01:44 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:01:44 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[67082ce5-b28f-40e2-a0a1-82c25bb22d29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0e351e-4818-4ce8-a190-55e5fa558d4c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 (non-flash)
Nov 03 14:01:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68618dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907'): ({'sdg'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Removing single pathed devices sdg {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589a71d-4e27-49a1-b6a7-1790863d9747]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885e1f2-cf9a-4ac9-991c-f43753942816]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Flushing IO for device /dev/sdg {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fba2d9-8787-4832-85d4-49ecffa515ec]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.067s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e0322-ad15-49ea-aa59-c3aee1e672fc]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbd2765-dcad-4e67-bf22-813a69c02a1d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46026165-5547-4741-9ae6-982f170e7519]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260]
Nov 03 14:01:44 user nova-compute[74582]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907, portal: 172.16.0.220,3260] successful.
Nov 03 14:01:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f51e9b4-2904-47bd-9d77-9406b2c20907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c339b0-659e-45c0-9834-a82a562b5ebb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] <== disconnect_volume: return (439ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:01:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'flavor' on Instance uuid b896be38-f944-448e-8f0c-2ff49fb396a8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:01:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4153b8d6-f10d-4296-b89b-24f939a70a0b tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.332s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:01:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:01:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:01:47 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:01:47 user nova-compute[74582]: INFO nova.compute.claims [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Claim successful on node user
Nov 03 14:01:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:01:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:01:48 user nova-compute[74582]: INFO nova.virt.block_device [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Booting with volume da79b803-1ea8-486a-bfa7-b5f67af6797a at /dev/vda
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.policy [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54ff58b22a904574bfb6e4f92af5226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938cabd29d654edc94cac90c27adf1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7eb039-6a84-4683-983a-f1055575fecc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6d7924-b3b8-4021-9213-f1f3c8731cc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c62015e-f192-4752-b196-300f0942c680]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d91fc5-12a0-4610-99b6-a3da9cd8eb7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:01:48 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:01:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d8fa28-4141-4480-94d3-a9cb2243f784]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:01:48 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating existing volume attachment record: 3b21e186-d706-4ee7-b0f5-e33918b809df {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:01:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully created port: 63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:01:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully created port: 37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:01:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully created port: c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:01:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully created port: 634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:01:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully created port: 8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:01:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: 63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-63344b70-dfc1-4bef-bead-ed43f9644d32. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port 63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b56e9fa7-f664-41d6-8432-495730507fd7 req-694e6198-1bff-471a-bd4a-cb22c5db92a4 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: 6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: 37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-6a027b3c-1b58-4d5d-b013-458053df7acd. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port 6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-a047da4c-eb2d-487d-87b9-e9c33222ec92. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-37b06a2c-20d9-48ff-995f-0404c8cfcb21. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:55 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port 37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:01:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e6651ad2-d448-4752-a7ee-b77d28b3b3db req-902854d8-2541-4871-8c7d-cc936be6cb28 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: 634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-c249a4b1-0d9c-4103-9177-de45f2c2d0c4. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Successfully updated port: 8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-634c9379-cbad-4756-9413-c0bf8b578acd. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port 634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f0938101-f749-4a02-a0bd-fac42b2a7ab6 req-6288bc01-9b8b-499b-a661-dc3bfa98e610 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:01:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-8c8000a0-4ebd-40a8-ba7f-6149580aabb9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance network_info: |[{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:01:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port 8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:02:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updated VIF entry in instance network info cache for port 8c8000a0-4ebd-40a8-ba7f-6149580aabb9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:02:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3a582c93-be6d-4937-aa23-5b816875d43b req-8d9bbf7a-6ce2-4891-bce0-54334adb3faa service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:07 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating instance_info_cache with network_info: [{"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-c73f6ba0-db7e-484e-980b-93642ef29001" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:02:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:11 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:02:11 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=25.14969253540039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:11 user nova-compute[74582]: INFO nova.virt.block_device [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Booting with volume 71cf17db-364c-44e4-be49-5d4464d30fe2 at /dev/vdb
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b896be38-f944-448e-8f0c-2ff49fb396a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance defe453f-2cfb-43e0-9e1f-9f5223258982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bfd1deec-6150-47c0-b319-02754d07e077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9e9b61ac-1001-4da7-8478-7c5665ad112a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:02:11 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d30cd62-ba04-4a5f-b625-90ca6e73d376]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a424a577-3bd5-4994-b6e5-4a9607f8e2a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ed3a5-b407-4389-bbb6-72608694fcd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef50022-ab7f-41b0-9d72-83fc100e0b33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:02:12 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa98622-b6ec-4a78-82d5-344cedc34dd8]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating existing volume attachment record: ce929239-5c48-406f-adac-f836f55abb71 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKstBIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:15 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:15 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:15 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b8d46c-4e17-43c6-87b8-f3ede9009d62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:02:15 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7a31d-c647-4b12-8900-2c3474d67304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0] added
Nov 03 14:02:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad816e9-f834-4c90-8624-3cc969fe90a3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[db98b0eb-f6f2-4e86-a71e-238576bf1e45]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKstBIue {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKstBIue" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ac43e0-2318-41e2-a106-97b132611e36]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKstBIue'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[007994f1-7091-4d85-8064-6ffcba659514]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a222c2-334f-4ded-8c0e-ac4c17a0274d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c72f68-8ead-4294-ba5e-0d4b5ff420dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260]
Nov 03 14:02:15 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260] successful.
Nov 03 14:02:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac2e151-e261-41d8-9604-f8a8b3d6d3b0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c28e229-ecd4-4676-9309-764dfd7c4c48]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c9bd46-2090-4076-a1c0-88d721a01ded]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKstBIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:15 user nova-compute[74582]: INFO nova.compute.manager [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Terminating instance
Nov 03 14:02:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-f707ad2b-739c-45fd-beb4-612e9e1b738f req-bdfa61da-aeb0-4996-a83a-b9df1f0a40be service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-vif-unplugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f707ad2b-739c-45fd-beb4-612e9e1b738f req-bdfa61da-aeb0-4996-a83a-b9df1f0a40be service nova] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f707ad2b-739c-45fd-beb4-612e9e1b738f req-bdfa61da-aeb0-4996-a83a-b9df1f0a40be service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f707ad2b-739c-45fd-beb4-612e9e1b738f req-bdfa61da-aeb0-4996-a83a-b9df1f0a40be service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-f707ad2b-739c-45fd-beb4-612e9e1b738f req-bdfa61da-aeb0-4996-a83a-b9df1f0a40be service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] No waiting events found dispatching network-vif-unplugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-f707ad2b-739c-45fd-beb4-612e9e1b738f req-bdfa61da-aeb0-4996-a83a-b9df1f0a40be service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-vif-unplugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:02:16 user nova-compute[74582]: INFO nova.compute.claims [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Claim successful on node user
Nov 03 14:02:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Instance destroyed successfully.
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lazy-loading 'resources' on Instance uuid b896be38-f944-448e-8f0c-2ff49fb396a8 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194269537',display_name='tempest-AttachVolumeNegativeTest-server-194269537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194269537',id=24,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZA1k/ambo6LgEKqq90HZCYjoSJ1SBXVSzNYwiEzQ9ibYlHav9EjFdSTiDOBRS7gTcpu50vbwst7ibl0XsYy+CpXq8S8UC809M26ZkF7USmcMfw/W3DiIvN6/i1/yZvWA==',key_name='tempest-keypair-1952785829',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d438a60c19854c4a93593908fb9b4390',ramdisk_id='',reservation_id='r-t9ecjx7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1460772866',owner_user_name='tempest-AttachVolumeNegativeTest-1460772866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64445061a214d13992b8b3bbacfb0c0',uuid=b896be38-f944-448e-8f0c-2ff49fb396a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converting VIF {"id": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "address": "fa:16:3e:53:85:ed", "network": {"id": "947c43dc-c57e-4a75-89e0-668ce1ae6932", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1973820455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d438a60c19854c4a93593908fb9b4390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0d2c8b-ee", "ovs_interfaceid": "ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG os_vif [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped0d2c8b-ee, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1d1d3a7-4212-40bd-ade3-1cc35f6ce745) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26561663663343464', 'path': '/dev/sdg'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561663663343464', 'path': '/dev/sdg'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:16 user nova-compute[74582]: INFO os_vif [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:85:ed,bridge_name='br-int',has_traffic_filtering=True,id=ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92,network=Network(947c43dc-c57e-4a75-89e0-668ce1ae6932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0d2c8b-ee')
Nov 03 14:02:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Deleting instance files /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8_del
Nov 03 14:02:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Deletion of /opt/stack/data/nova/instances/b896be38-f944-448e-8f0c-2ff49fb396a8_del complete
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:02:16 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:02:16 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 14:02:16 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:02:16 user nova-compute[74582]:   <serial>fc5d15b9-202d-4fce-b763-2e6e297152f0</serial>
Nov 03 14:02:16 user nova-compute[74582]: </disk>
Nov 03 14:02:16 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:02:16 user nova-compute[74582]: INFO nova.compute.manager [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:02:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:02:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.policy [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b40b982348e4a42be1953ce067bd977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bce1e208f4b809df3cd71cccf1064', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:02:17 user nova-compute[74582]: INFO nova.virt.block_device [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Booting with volume 42fa1d41-757f-4698-9f7f-b08067eb655b at /dev/vda
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No VIF found with MAC fa:16:3e:67:ae:69, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG os_brick.utils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89de082-a9b5-4b7f-9cdf-5b8028f6c2cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b77a3b-d22d-41cc-8143-e4c242a1f0ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47d53c-5290-4a35-ac0e-08b7d23004f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f992c169-c5bd-48ca-a16d-85005dc011e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:02:17 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[329dc8c1-053d-4bdd-9898-f5a118d077b8]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG os_brick.utils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating existing volume attachment record: 4279f853-b3ae-4c42-b15b-cdee6f966f97 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4d68c0eb-b337-45f0-9788-8faa0432825d tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 76.676s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:17 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Took 0.98 seconds to deallocate network for instance.
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:17 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Successfully created port: b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:18 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Deleted allocations for instance b896be38-f944-448e-8f0c-2ff49fb396a8
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] Acquiring lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] No waiting events found dispatching network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:18 user nova-compute[74582]: WARNING nova.compute.manager [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received unexpected event network-vif-plugged-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 for instance with vm_state deleted and task_state None.
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-43e0217a-bc21-4e7f-96f9-082a743115e6 req-ef5fbc77-37a0-4157-ba54-b9f4ab0a1223 service nova] [instance: b896be38-f944-448e-8f0c-2ff49fb396a8] Received event network-vif-deleted-ed0d2c8b-ee62-4bf9-ac62-bdf894ad9c92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c0e9d33c-964c-4daf-8af8-e9a5e99264fe tempest-AttachVolumeNegativeTest-1460772866 tempest-AttachVolumeNegativeTest-1460772866-project-member] Lock "b896be38-f944-448e-8f0c-2ff49fb396a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.638s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Successfully updated port: b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing instance network info cache due to event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance network_info: |[{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:18 user nova-compute[74582]: DEBUG nova.network.neutron [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:02:19 user nova-compute[74582]: DEBUG nova.network.neutron [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updated VIF entry in instance network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:02:19 user nova-compute[74582]: DEBUG nova.network.neutron [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13251d37-8c8b-49e3-9e37-c744aad546ad req-11647609-b74f-4ebf-854b-a07c00d6cc13 service nova] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPDzeCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:26 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:26 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:26 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff25fd03-f7f5-4840-92ea-4dacf3ffb40d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:02:26 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9806bfb-49e0-475f-bfb0-655c194098cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984] added
Nov 03 14:02:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc8dfa-7a74-4c92-a73a-cf2188ddec8d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e88b31-f04e-4f24-bcaa-cfda12e91079]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaPDzeCp {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaPDzeCp" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[364e2809-2823-4579-b9c7-486e6648ccc0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZaPDzeCp'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690c172-6370-4232-a801-c2f876ebf136]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c5e258-9fb5-4908-8009-f700a45bf0f0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32272a2-83f4-4047-aee1-8a5311b4df90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260]
Nov 03 14:02:26 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260] successful.
Nov 03 14:02:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f458bd3d-5dd0-48db-a2df-2d0ded1751b6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ac647-a596-46f5-863f-96c254821df3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b3b01d-efd0-4ed5-8ad2-7f0446df7cfd]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPDzeCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:02:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23434326130326333', 'path': '/dev/sdh'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434326130326333', 'path': '/dev/sdh'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:02:27 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:02:27 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:02:27 user nova-compute[74582]:   <source dev="/dev/sdh"/>
Nov 03 14:02:27 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:02:27 user nova-compute[74582]:   <serial>3c486f8c-6863-4569-a54f-7d0286cf5984</serial>
Nov 03 14:02:27 user nova-compute[74582]: </disk>
Nov 03 14:02:27 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:02:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:02:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:02:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] No VIF found with MAC fa:16:3e:40:c0:b6, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:02:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b8baa5ef-6e84-4567-a1ad-7542427fdabc tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 77.945s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:30 user nova-compute[74582]: INFO nova.compute.manager [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Detaching volume 3c486f8c-6863-4569-a54f-7d0286cf5984
Nov 03 14:02:30 user nova-compute[74582]: INFO nova.virt.block_device [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Attempting to driver detach volume 3c486f8c-6863-4569-a54f-7d0286cf5984 from mountpoint /dev/vdb
Nov 03 14:02:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Attempting to detach device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:02:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:02:30 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:02:30 user nova-compute[74582]:   <source dev="/dev/sdh"/>
Nov 03 14:02:30 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:02:30 user nova-compute[74582]:   <serial>3c486f8c-6863-4569-a54f-7d0286cf5984</serial>
Nov 03 14:02:30 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:02:30 user nova-compute[74582]: </disk>
Nov 03 14:02:30 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:02:30 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the persistent domain config.
Nov 03 14:02:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:02:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:02:30 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:02:30 user nova-compute[74582]:   <source dev="/dev/sdh"/>
Nov 03 14:02:30 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:02:30 user nova-compute[74582]:   <serial>3c486f8c-6863-4569-a54f-7d0286cf5984</serial>
Nov 03 14:02:30 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:02:30 user nova-compute[74582]: </disk>
Nov 03 14:02:30 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:02:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:02:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-changed-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing instance network info cache due to event network-changed-ee122f85-2da5-48e8-9c09-8df2a931bad2. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] Acquiring lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] Acquired lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG nova.network.neutron [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Refreshing network info cache for port ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:34 user nova-compute[74582]: DEBUG nova.network.neutron [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updated VIF entry in instance network info cache for port ee122f85-2da5-48e8-9c09-8df2a931bad2. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:02:34 user nova-compute[74582]: DEBUG nova.network.neutron [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [{"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0f4e7aff-730f-4611-9b6b-09f7ec9f50ff req-9bd726f9-37e5-4abc-a831-d4dace0fe6d7 service nova] Releasing lock "refresh_cache-9e9b61ac-1001-4da7-8478-7c5665ad112a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:36 user nova-compute[74582]: INFO nova.compute.manager [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Terminating instance
Nov 03 14:02:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-4b71f27a-e778-46ed-972b-fb3f7f2d77c1 req-a12fda9d-9a08-42e3-8165-2bcae9b32f5d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4b71f27a-e778-46ed-972b-fb3f7f2d77c1 req-a12fda9d-9a08-42e3-8165-2bcae9b32f5d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4b71f27a-e778-46ed-972b-fb3f7f2d77c1 req-a12fda9d-9a08-42e3-8165-2bcae9b32f5d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4b71f27a-e778-46ed-972b-fb3f7f2d77c1 req-a12fda9d-9a08-42e3-8165-2bcae9b32f5d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-4b71f27a-e778-46ed-972b-fb3f7f2d77c1 req-a12fda9d-9a08-42e3-8165-2bcae9b32f5d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-4b71f27a-e778-46ed-972b-fb3f7f2d77c1 req-a12fda9d-9a08-42e3-8165-2bcae9b32f5d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-d0609d4a-3c7a-485d-bb5a-4917bba99c99 req-1ee9bb4d-637c-4457-ba4b-aabd4ca16657 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d0609d4a-3c7a-485d-bb5a-4917bba99c99 req-1ee9bb4d-637c-4457-ba4b-aabd4ca16657 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d0609d4a-3c7a-485d-bb5a-4917bba99c99 req-1ee9bb4d-637c-4457-ba4b-aabd4ca16657 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d0609d4a-3c7a-485d-bb5a-4917bba99c99 req-1ee9bb4d-637c-4457-ba4b-aabd4ca16657 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-d0609d4a-3c7a-485d-bb5a-4917bba99c99 req-1ee9bb4d-637c-4457-ba4b-aabd4ca16657 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-d0609d4a-3c7a-485d-bb5a-4917bba99c99 req-1ee9bb4d-637c-4457-ba4b-aabd4ca16657 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-f54a5507-fb72-48ce-98e6-722236fc4d87 req-9634eff3-a377-4e6b-b52f-a5caaf6ec887 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f54a5507-fb72-48ce-98e6-722236fc4d87 req-9634eff3-a377-4e6b-b52f-a5caaf6ec887 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f54a5507-fb72-48ce-98e6-722236fc4d87 req-9634eff3-a377-4e6b-b52f-a5caaf6ec887 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f54a5507-fb72-48ce-98e6-722236fc4d87 req-9634eff3-a377-4e6b-b52f-a5caaf6ec887 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-f54a5507-fb72-48ce-98e6-722236fc4d87 req-9634eff3-a377-4e6b-b52f-a5caaf6ec887 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-f54a5507-fb72-48ce-98e6-722236fc4d87 req-9634eff3-a377-4e6b-b52f-a5caaf6ec887 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Instance destroyed successfully.
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.objects.instance [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lazy-loading 'resources' on Instance uuid 9e9b61ac-1001-4da7-8478-7c5665ad112a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee122f85-2d, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bae3332e-b666-4bd9-a937-77dc50f2c102) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:57:5d,bridge_name='br-int',has_traffic_filtering=True,id=ee122f85-2da5-48e8-9c09-8df2a931bad2,network=Network(61298b3c-e25b-4cd7-b739-346808d4a90f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee122f85-2d')
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0ecf951-37, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aca829d1-45f4-4cde-8ac1-7cd070ad79c8) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:07,bridge_name='br-int',has_traffic_filtering=True,id=f0ecf951-377c-4180-a575-8c9a3d3f8cc1,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0ecf951-37')
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap560214e5-1c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4c56584-0236-42c1-a5dd-94c840d64c4b) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7c:a0,bridge_name='br-int',has_traffic_filtering=True,id=560214e5-1c3e-42e9-a466-bd14a9f9dc7f,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap560214e5-1c')
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c5501c3-50, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de95c7fe-82d1-4996-9f0c-1451c5a0a26c) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:6e,bridge_name='br-int',has_traffic_filtering=True,id=7c5501c3-504c-43c3-8754-e4b9df6c5d65,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5501c3-50')
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f37f7eb-71, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bba3f62-7915-4529-ba6c-8764d28089d6) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b7:87,bridge_name='br-int',has_traffic_filtering=True,id=6f37f7eb-7132-4cc3-b637-8a5e027640ed,network=Network(236909b4-abd9-41e5-a707-88a8247a0bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f37f7eb-71')
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "address": "fa:16:3e:cb:b5:57", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb598b89e-34", "ovs_interfaceid": "b598b89e-341e-42f2-9a02-1cbfc77be2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb598b89e-34, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2648353-35fe-4aa2-8ab5-f35ba7ea9d65) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:b5:57,bridge_name='br-int',has_traffic_filtering=True,id=b598b89e-341e-42f2-9a02-1cbfc77be2e6,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb598b89e-34')
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T13:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1137958868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1137958868',id=27,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWeXTLpqzDJ5uRupvnfwGWs1pFUGYKTGPXvHA45+v3oL/+RSXlGFk962esmHg9tDDnToxyyrxddzpxeU3eyGHEL2wfNK3t/Bg5y9hhYw38D0NqhhrCc9EbQH+7VEYWfZA==',key_name='tempest-keypair-92459087',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08aee9ee017e4336b09fd4bb71033d37',ramdisk_id='',reservation_id='r-s0gclesq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-125788020',owner_user_name='tempest-TaggedBootDevicesTest_v242-125788020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='545e5fce790547b8913e2a83ae1a1008',uuid=9e9b61ac-1001-4da7-8478-7c5665ad112a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converting VIF {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfd9e781-9c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ca53cb7-f908-4a36-99e8-4c25c8da2221) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:39 user nova-compute[74582]: INFO os_vif [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e7:dc,bridge_name='br-int',has_traffic_filtering=True,id=dfd9e781-9ccb-4b3c-966d-592423a7c189,network=Network(1f0feb6d-4345-4ec4-b576-9d18a99f544c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9e781-9c')
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afcALlhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5479225-aec3-4477-8580-4e064adfc74a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]: iSNS:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]: STATIC:
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: FIRMWARE:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:02:39 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:02:39 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccb322c-5802-42fd-a022-caaadc56ee1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae49af-9be4-4613-9f36-829dd8a87f5b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682d0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7'): ({'sde'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Removing single pathed devices sde {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2474dd82-a4d2-45e0-8404-5949a884ac64]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde46037-18d9-4b80-a5bd-ead2be31f503]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Flushing IO for device /dev/sde {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dd3b5d-696d-423e-951a-08d188fd6f9c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-b5821196-6faa-4971-a3ce-35d1885bfa3c req-4acd9f26-d419-4cfe-bb44-6df39e7c3589 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b5821196-6faa-4971-a3ce-35d1885bfa3c req-4acd9f26-d419-4cfe-bb44-6df39e7c3589 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b5821196-6faa-4971-a3ce-35d1885bfa3c req-4acd9f26-d419-4cfe-bb44-6df39e7c3589 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b5821196-6faa-4971-a3ce-35d1885bfa3c req-4acd9f26-d419-4cfe-bb44-6df39e7c3589 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-b5821196-6faa-4971-a3ce-35d1885bfa3c req-4acd9f26-d419-4cfe-bb44-6df39e7c3589 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING nova.compute.manager [req-b5821196-6faa-4971-a3ce-35d1885bfa3c req-4acd9f26-d419-4cfe-bb44-6df39e7c3589 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-6f37f7eb-7132-4cc3-b637-8a5e027640ed for instance with vm_state active and task_state deleting.
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.068s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[81af8b92-90c8-4604-b1ad-0e91eda3e1f8]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a34376-3794-4025-80e6-d980542541f3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-cef5b7ee-2e31-4ff7-b2b8-5d09a437da19 req-6546b42d-7d08-46b8-b088-e3b9fac8b459 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cef5b7ee-2e31-4ff7-b2b8-5d09a437da19 req-6546b42d-7d08-46b8-b088-e3b9fac8b459 service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cef5b7ee-2e31-4ff7-b2b8-5d09a437da19 req-6546b42d-7d08-46b8-b088-e3b9fac8b459 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cef5b7ee-2e31-4ff7-b2b8-5d09a437da19 req-6546b42d-7d08-46b8-b088-e3b9fac8b459 service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-cef5b7ee-2e31-4ff7-b2b8-5d09a437da19 req-6546b42d-7d08-46b8-b088-e3b9fac8b459 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING nova.compute.manager [req-cef5b7ee-2e31-4ff7-b2b8-5d09a437da19 req-6546b42d-7d08-46b8-b088-e3b9fac8b459 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-7c5501c3-504c-43c3-8754-e4b9df6c5d65 for instance with vm_state active and task_state deleting.
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4dd597-02d2-409f-8d6a-014eca97dedc]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260]
Nov 03 14:02:39 user nova-compute[74582]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7, portal: 172.16.0.220,3260] successful.
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-ee122f85-2da5-48e8-9c09-8df2a931bad2 for instance with vm_state active and task_state deleting.
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-f0ecf951-377c-4180-a575-8c9a3d3f8cc1 for instance with vm_state active and task_state deleting.
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-560214e5-1c3e-42e9-a466-bd14a9f9dc7f for instance with vm_state active and task_state deleting.
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING nova.compute.manager [req-d1acddfe-eb6a-484f-b80f-fffd304dd0d0 req-25f49785-b905-43e4-95d1-8a706c84307d service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-b598b89e-341e-42f2-9a02-1cbfc77be2e6 for instance with vm_state active and task_state deleting.
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375901e6-0fd5-4505-a67e-70d55d3855f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c21cdc-2e4d-4c67-b907-0856ce5fa52b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== disconnect_volume: return (429ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ertoPSQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fe51ee-2c7d-4ca9-8642-e70cd4e2a015]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]: iSNS:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]: STATIC:
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: FIRMWARE:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:02:39 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:02:39 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba32957-c092-465e-8f15-f4630c6e4c9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[18330e7c-3d99-40e0-bf56-ed7c3021b27d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f8010dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ac1fd-c353-43fb-a140-553902578724]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3503cb-8288-4ed1-b8f8-6571e68453d8]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ce968-9543-4b19-b891-2a8e86afae56]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e84c8d8-e0bb-4865-ac02-e97ef817c6ec]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc744c-5e2d-46bb-8795-ae3825ef5766]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f5eb8b-3c89-4ef0-aa70-926d74e5dc89]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260]
Nov 03 14:02:39 user nova-compute[74582]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014, portal: 172.16.0.220,3260] successful.
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a966bf00-0eb1-41d2-8f70-659557240014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56cfd31-6e5e-4af3-8d0c-f2df33ab5073]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== disconnect_volume: return (341ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YobVnKHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:39 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c36f6f-eda9-4a73-b1c9-7109805a5c4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]: iSNS:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]: STATIC:
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:02:39 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:39 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:39 user nova-compute[74582]: FIRMWARE:
Nov 03 14:02:39 user nova-compute[74582]: No targets found.
Nov 03 14:02:39 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:02:39 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:02:39 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:39 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3fdc99-1b18-4a1f-a9da-06a136c76289]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaed169-49f7-4ff6-ba43-94ea68585c15]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:40 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f8010dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79'): ({'sdf'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Removing single pathed devices sdf {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8adbaf-e00b-4c0b-9081-ab96615f9b2e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b71edae-be22-486f-9b7d-eb107fc45cfd]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Flushing IO for device /dev/sdf {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035e418-fc73-45e1-b2ff-5fca46dadd95]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb767449-0cb0-4553-9dcc-6f8daf091a0b]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[74296525-6550-40e1-af8c-d73ed3c1aced]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ffdea4-78a7-4472-ba38-03074f5f27ad]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260]
Nov 03 14:02:40 user nova-compute[74582]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79, portal: 172.16.0.220,3260] successful.
Nov 03 14:02:40 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2b4f6eb-1a96-4f55-99fe-2bbcb756fb79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63808e3-c56c-457c-aa0e-6345e3cf16f9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] <== disconnect_volume: return (362ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:02:40 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Deleting instance files /opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a_del
Nov 03 14:02:40 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Deletion of /opt/stack/data/nova/instances/9e9b61ac-1001-4da7-8478-7c5665ad112a_del complete
Nov 03 14:02:40 user nova-compute[74582]: INFO nova.compute.manager [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Took 3.92 seconds to destroy the instance on the hypervisor.
Nov 03 14:02:40 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:02:40 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-unplugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-unplugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] Acquiring lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] No waiting events found dispatching network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:41 user nova-compute[74582]: WARNING nova.compute.manager [req-83e70620-8528-4dc4-8d2b-cb7007657b03 req-51684aff-b805-413f-b278-aaf379d24cec service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received unexpected event network-vif-plugged-dfd9e781-9ccb-4b3c-966d-592423a7c189 for instance with vm_state active and task_state deleting.
Nov 03 14:02:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-1a17215c-94d4-4b11-a38d-cd7eb6828721 req-1194a81a-6f13-4efc-9996-b0413b816b9b service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-deleted-b598b89e-341e-42f2-9a02-1cbfc77be2e6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:42 user nova-compute[74582]: INFO nova.compute.manager [req-1a17215c-94d4-4b11-a38d-cd7eb6828721 req-1194a81a-6f13-4efc-9996-b0413b816b9b service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Neutron deleted interface b598b89e-341e-42f2-9a02-1cbfc77be2e6; detaching it from the instance and deleting it from the info cache
Nov 03 14:02:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-1a17215c-94d4-4b11-a38d-cd7eb6828721 req-1194a81a-6f13-4efc-9996-b0413b816b9b service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [{"id": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "address": "fa:16:3e:2a:57:5d", "network": {"id": "61298b3c-e25b-4cd7-b739-346808d4a90f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1231386890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee122f85-2d", "ovs_interfaceid": "ee122f85-2da5-48e8-9c09-8df2a931bad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "address": "fa:16:3e:05:9d:07", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ecf951-37", "ovs_interfaceid": "f0ecf951-377c-4180-a575-8c9a3d3f8cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "address": "fa:16:3e:71:7c:a0", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560214e5-1c", "ovs_interfaceid": "560214e5-1c3e-42e9-a466-bd14a9f9dc7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "address": "fa:16:3e:4d:15:6e", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5501c3-50", "ovs_interfaceid": "7c5501c3-504c-43c3-8754-e4b9df6c5d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "address": "fa:16:3e:0c:b7:87", "network": {"id": "236909b4-abd9-41e5-a707-88a8247a0bf5", "bridge": "br-int", "label": "tempest-device-tagging-net1-465354343", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f37f7eb-71", "ovs_interfaceid": "6f37f7eb-7132-4cc3-b637-8a5e027640ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "address": "fa:16:3e:cb:e7:dc", "network": {"id": "1f0feb6d-4345-4ec4-b576-9d18a99f544c", "bridge": "br-int", "label": "tempest-device-tagging-net2-181556931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "08aee9ee017e4336b09fd4bb71033d37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9e781-9c", "ovs_interfaceid": "dfd9e781-9ccb-4b3c-966d-592423a7c189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-1a17215c-94d4-4b11-a38d-cd7eb6828721 req-1194a81a-6f13-4efc-9996-b0413b816b9b service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Detach interface failed, port_id=b598b89e-341e-42f2-9a02-1cbfc77be2e6, reason: Instance 9e9b61ac-1001-4da7-8478-7c5665ad112a could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:43 user nova-compute[74582]: INFO nova.compute.manager [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attaching volume 66ec6c76-18f4-4ce6-92bc-e527d09aa09c to /dev/vdc
Nov 03 14:02:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1bbab-45fd-47ed-bfb9-646d7f731998]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f039f8f0-a14b-4a72-8e4e-81a8c8ebd714]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df42aac-74ab-4d79-b515-326b6142283e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37714b98-a6b3-4633-a495-a760643d1f57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:02:43 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:02:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9e803-ae7c-4bdc-81c8-e36f1e3742da]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:43 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updating existing volume attachment record: 930b3327-0703-4ce6-ae68-e7f6ab8fc186 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:02:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:44 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:44 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Took 4.32 seconds to deallocate network for instance.
Nov 03 14:02:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-4cdbd478-2a28-4b59-8823-7235a686c2a4 req-3e3085ba-4fa9-4b79-abdc-4d1cb3b6b585 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-deleted-ee122f85-2da5-48e8-9c09-8df2a931bad2 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-4cdbd478-2a28-4b59-8823-7235a686c2a4 req-3e3085ba-4fa9-4b79-abdc-4d1cb3b6b585 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-deleted-6f37f7eb-7132-4cc3-b637-8a5e027640ed {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-4cdbd478-2a28-4b59-8823-7235a686c2a4 req-3e3085ba-4fa9-4b79-abdc-4d1cb3b6b585 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-deleted-dfd9e781-9ccb-4b3c-966d-592423a7c189 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-4cdbd478-2a28-4b59-8823-7235a686c2a4 req-3e3085ba-4fa9-4b79-abdc-4d1cb3b6b585 service nova] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Received event network-vif-deleted-7c5501c3-504c-43c3-8754-e4b9df6c5d65 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:47 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:02:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 0 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:02:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:02:50 user nova-compute[74582]: INFO nova.compute.claims [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Claim successful on node user
Nov 03 14:02:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:02:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:02:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.policy [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3230b5c41139457a8e652d5c8f60ea7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24834f917a16463fb400b4028ff97a0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:02:51 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c73f6ba0-db7e-484e-980b-93642ef29001 is timed out.
Nov 03 14:02:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully detached device vdb from instance c73f6ba0-db7e-484e-980b-93642ef29001 from the live domain config.
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPDzeCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:02:51 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f372324-93f2-401d-ab92-290169fbf5f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:02:51 user nova-compute[74582]: No targets found.
Nov 03 14:02:51 user nova-compute[74582]: iSNS:
Nov 03 14:02:51 user nova-compute[74582]: No targets found.
Nov 03 14:02:51 user nova-compute[74582]: STATIC:
Nov 03 14:02:51 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0
Nov 03 14:02:51 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:51 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:51 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984
Nov 03 14:02:51 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:51 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:51 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:02:51 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:51 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:51 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:02:51 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:02:51 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:02:51 user nova-compute[74582]: FIRMWARE:
Nov 03 14:02:51 user nova-compute[74582]: No targets found.
Nov 03 14:02:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:02:51 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:02:51 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[030082af-57eb-49c3-9693-b3d966416abc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[20581967-a0d9-4167-9e01-1fb3620b77d0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 (non-flash)
Nov 03 14:02:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682d1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984'): ({'sdh'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Removing single pathed devices sdh {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:02:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Creating image(s)
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "/opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "/opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "/opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e4e4c9-4625-46d2-b885-166cde61b138]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c1919-a67a-4747-ae89-c8aaf664eca3]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Flushing IO for device /dev/sdh {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b7dca-6355-4fa1-9f48-dc3bd812b44b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37615988-5191-428b-98ad-fff27049fc9b]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] SCSI volumes sdh have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7438a660-6f9a-40a1-8e9a-fbcde6e237db]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.215s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42372921-d67e-44da-8d1a-04d22062d1b7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260]
Nov 03 14:02:51 user nova-compute[74582]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984, portal: 172.16.0.220,3260] successful.
Nov 03 14:02:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c486f8c-6863-4569-a54f-7d0286cf5984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[852e10f1-954e-4ac6-840d-7c02bd03c2ae]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] <== disconnect_volume: return (417ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:02:51 user nova-compute[74582]: INFO nova.compute.claims [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Claim successful on node user
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Successfully created port: c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk 1073741824" returned: 0 in 0.062s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:02:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Cannot resize image /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Ensure instance console log exists: /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:02:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.policy [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd63da82cd28e43849a1c8d8572385bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9069ac678f934449beb0ae6adf96911e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Successfully updated port: c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:02:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Creating image(s)
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50c8047b5838b725377e56ae533462191d12267b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50c8047b5838b725377e56ae533462191d12267b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "refresh_cache-a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquired lock "refresh_cache-a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-changed-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Refreshing instance network info cache due to event network-changed-c2608fcc-defb-47ab-997a-97382a6d7b52. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] Acquiring lock "refresh_cache-a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:02:52 user nova-compute[74582]: DEBUG nova.network.neutron [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Successfully created port: eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.images [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] db79ffbd-73c1-4880-8895-06a5ba7cd25c was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.part /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Updating instance_info_cache with network_info: [{"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Releasing lock "refresh_cache-a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Instance network_info: |[{"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] Acquired lock "refresh_cache-a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Refreshing network info cache for port c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Start _get_guest_xml network_info=[{"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:02:53 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:02:53 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.part /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.converted" returned: 0 in 0.411s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-124149186',display_name='tempest-VolumesActionsTest-instance-124149186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-124149186',id=30,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24834f917a16463fb400b4028ff97a0e',ramdisk_id='',reservation_id='r-eltyhj5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1234039932',owner_user_name='tempest-VolumesActionsTest-1234039932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:02:51Z,user_data=None,user_id='3230b5c41139457a8e652d5c8f60ea7f',uuid=a967ee46-aa7b-4667-8b6d-54c4c3b0bae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Converting VIF {"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.objects.instance [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lazy-loading 'pci_devices' on Instance uuid a967ee46-aa7b-4667-8b6d-54c4c3b0bae1 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:02:53 user nova-compute[74582]:   <uuid>a967ee46-aa7b-4667-8b6d-54c4c3b0bae1</uuid>
Nov 03 14:02:53 user nova-compute[74582]:   <name>instance-0000001e</name>
Nov 03 14:02:53 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:02:53 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:02:53 user nova-compute[74582]:   <metadata>
Nov 03 14:02:53 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:02:53 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:02:53 user nova-compute[74582]:       <nova:name>tempest-VolumesActionsTest-instance-124149186</nova:name>
Nov 03 14:02:53 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:02:53</nova:creationTime>
Nov 03 14:02:53 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:02:53 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:02:53 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:02:53 user nova-compute[74582]:       <nova:owner>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:user uuid="3230b5c41139457a8e652d5c8f60ea7f">tempest-VolumesActionsTest-1234039932-project-member</nova:user>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:project uuid="24834f917a16463fb400b4028ff97a0e">tempest-VolumesActionsTest-1234039932</nova:project>
Nov 03 14:02:53 user nova-compute[74582]:       </nova:owner>
Nov 03 14:02:53 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:02:53 user nova-compute[74582]:       <nova:ports>
Nov 03 14:02:53 user nova-compute[74582]:         <nova:port uuid="c2608fcc-defb-47ab-997a-97382a6d7b52">
Nov 03 14:02:53 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 14:02:53 user nova-compute[74582]:         </nova:port>
Nov 03 14:02:53 user nova-compute[74582]:       </nova:ports>
Nov 03 14:02:53 user nova-compute[74582]:     </nova:instance>
Nov 03 14:02:53 user nova-compute[74582]:   </metadata>
Nov 03 14:02:53 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:02:53 user nova-compute[74582]:     <system>
Nov 03 14:02:53 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:02:53 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:02:53 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:02:53 user nova-compute[74582]:       <entry name="serial">a967ee46-aa7b-4667-8b6d-54c4c3b0bae1</entry>
Nov 03 14:02:53 user nova-compute[74582]:       <entry name="uuid">a967ee46-aa7b-4667-8b6d-54c4c3b0bae1</entry>
Nov 03 14:02:53 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:02:53 user nova-compute[74582]:     </system>
Nov 03 14:02:53 user nova-compute[74582]:   </sysinfo>
Nov 03 14:02:53 user nova-compute[74582]:   <os>
Nov 03 14:02:53 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:02:53 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:02:53 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:02:53 user nova-compute[74582]:   </os>
Nov 03 14:02:53 user nova-compute[74582]:   <features>
Nov 03 14:02:53 user nova-compute[74582]:     <acpi/>
Nov 03 14:02:53 user nova-compute[74582]:     <apic/>
Nov 03 14:02:53 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:02:53 user nova-compute[74582]:   </features>
Nov 03 14:02:53 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:02:53 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:02:53 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:02:53 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:02:53 user nova-compute[74582]:   </clock>
Nov 03 14:02:53 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:02:53 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:02:53 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:02:53 user nova-compute[74582]:   </cpu>
Nov 03 14:02:53 user nova-compute[74582]:   <devices>
Nov 03 14:02:53 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:02:53 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:02:53 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk"/>
Nov 03 14:02:53 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:02:53 user nova-compute[74582]:     </disk>
Nov 03 14:02:53 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:02:53 user nova-compute[74582]:       <mac address="fa:16:3e:cf:88:07"/>
Nov 03 14:02:53 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:02:53 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:02:53 user nova-compute[74582]:       <target dev="tapc2608fcc-de"/>
Nov 03 14:02:53 user nova-compute[74582]:     </interface>
Nov 03 14:02:53 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:02:53 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/console.log" append="off"/>
Nov 03 14:02:53 user nova-compute[74582]:     </serial>
Nov 03 14:02:53 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:02:53 user nova-compute[74582]:     <video>
Nov 03 14:02:53 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:02:53 user nova-compute[74582]:     </video>
Nov 03 14:02:53 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:02:53 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:02:53 user nova-compute[74582]:     </rng>
Nov 03 14:02:53 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:02:53 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:02:53 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:02:53 user nova-compute[74582]:     </memballoon>
Nov 03 14:02:53 user nova-compute[74582]:   </devices>
Nov 03 14:02:53 user nova-compute[74582]: </domain>
Nov 03 14:02:53 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-124149186',display_name='tempest-VolumesActionsTest-instance-124149186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-124149186',id=30,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24834f917a16463fb400b4028ff97a0e',ramdisk_id='',reservation_id='r-eltyhj5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1234039932',owner_user_name='tempest-VolumesActionsTest-1234039932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:02:51Z,user_data=None,user_id='3230b5c41139457a8e652d5c8f60ea7f',uuid=a967ee46-aa7b-4667-8b6d-54c4c3b0bae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Converting VIF {"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG os_vif [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0452abeb-f319-509b-b80a-4dd06db322f9', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2608fcc-de, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2608fcc-de, col_values=(('qos', UUID('6bf102e7-f057-4d94-a933-7f947e8ebe07')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2608fcc-de, col_values=(('external_ids', {'iface-id': 'c2608fcc-defb-47ab-997a-97382a6d7b52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:88:07', 'vm-uuid': 'a967ee46-aa7b-4667-8b6d-54c4c3b0bae1'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:53 user nova-compute[74582]: INFO os_vif [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de')
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50c8047b5838b725377e56ae533462191d12267b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.256s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] No VIF found with MAC fa:16:3e:cf:88:07, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Successfully updated port: eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing instance network info cache due to event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50c8047b5838b725377e56ae533462191d12267b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50c8047b5838b725377e56ae533462191d12267b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Updated VIF entry in instance network info cache for port c2608fcc-defb-47ab-997a-97382a6d7b52. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Updating instance_info_cache with network_info: [{"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0293c794-e6dc-4a03-9707-fcbb9ca06aca req-25f807a6-eff3-40df-b491-a4fe648bc772 service nova] Releasing lock "refresh_cache-a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b,backing_fmt=raw /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b,backing_fmt=raw /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk 1073741824" returned: 0 in 0.051s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50c8047b5838b725377e56ae533462191d12267b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance network_info: |[{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.neutron [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Cannot resize image /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Ensure instance console log exists: /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Start _get_guest_xml network_info=[{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=db79ffbd-73c1-4880-8895-06a5ba7cd25c,min_disk=0,min_ram=0,name='tempest-scenario-img--1421557583',owner='9069ac678f934449beb0ae6adf96911e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T14:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'db79ffbd-73c1-4880-8895-06a5ba7cd25c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:02:54 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:02:54 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T14:02:48Z,direct_url=<?>,disk_format='qcow2',id=db79ffbd-73c1-4880-8895-06a5ba7cd25c,min_disk=0,min_ram=0,name='tempest-scenario-img--1421557583',owner='9069ac678f934449beb0ae6adf96911e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T14:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687070852',display_name='tempest-TestMinimumBasicScenario-server-1687070852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687070852',id=31,image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXbt00hUhVjJka/8XJWIzVA/aV0ZDnlyeHXSd9zVxLtEsVmvJmpu5TbVD9WHOvl4YjmUhDJkjW/pJ/hjS/mkQ6NMOTQMBndodmqcfHsMdXZDdKQ16w9ZdlHzeY0+2GcTw==',key_name='tempest-TestMinimumBasicScenario-97236426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-g3b17wod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:02:52Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=1b594495-ee96-4a48-a789-ab1d14135410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.objects.instance [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:02:54 user nova-compute[74582]:   <uuid>1b594495-ee96-4a48-a789-ab1d14135410</uuid>
Nov 03 14:02:54 user nova-compute[74582]:   <name>instance-0000001f</name>
Nov 03 14:02:54 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:02:54 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:02:54 user nova-compute[74582]:   <metadata>
Nov 03 14:02:54 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:02:54 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:02:54 user nova-compute[74582]:       <nova:name>tempest-TestMinimumBasicScenario-server-1687070852</nova:name>
Nov 03 14:02:54 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:02:54</nova:creationTime>
Nov 03 14:02:54 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:02:54 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:02:54 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:02:54 user nova-compute[74582]:       <nova:owner>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:user uuid="d63da82cd28e43849a1c8d8572385bf7">tempest-TestMinimumBasicScenario-1621292284-project-member</nova:user>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:project uuid="9069ac678f934449beb0ae6adf96911e">tempest-TestMinimumBasicScenario-1621292284</nova:project>
Nov 03 14:02:54 user nova-compute[74582]:       </nova:owner>
Nov 03 14:02:54 user nova-compute[74582]:       <nova:root type="image" uuid="db79ffbd-73c1-4880-8895-06a5ba7cd25c"/>
Nov 03 14:02:54 user nova-compute[74582]:       <nova:ports>
Nov 03 14:02:54 user nova-compute[74582]:         <nova:port uuid="eb5dbb6f-1cf8-4b3a-a747-275e16d52d75">
Nov 03 14:02:54 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 14:02:54 user nova-compute[74582]:         </nova:port>
Nov 03 14:02:54 user nova-compute[74582]:       </nova:ports>
Nov 03 14:02:54 user nova-compute[74582]:     </nova:instance>
Nov 03 14:02:54 user nova-compute[74582]:   </metadata>
Nov 03 14:02:54 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:02:54 user nova-compute[74582]:     <system>
Nov 03 14:02:54 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:02:54 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:02:54 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:02:54 user nova-compute[74582]:       <entry name="serial">1b594495-ee96-4a48-a789-ab1d14135410</entry>
Nov 03 14:02:54 user nova-compute[74582]:       <entry name="uuid">1b594495-ee96-4a48-a789-ab1d14135410</entry>
Nov 03 14:02:54 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:02:54 user nova-compute[74582]:     </system>
Nov 03 14:02:54 user nova-compute[74582]:   </sysinfo>
Nov 03 14:02:54 user nova-compute[74582]:   <os>
Nov 03 14:02:54 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:02:54 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:02:54 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:02:54 user nova-compute[74582]:   </os>
Nov 03 14:02:54 user nova-compute[74582]:   <features>
Nov 03 14:02:54 user nova-compute[74582]:     <acpi/>
Nov 03 14:02:54 user nova-compute[74582]:     <apic/>
Nov 03 14:02:54 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:02:54 user nova-compute[74582]:   </features>
Nov 03 14:02:54 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:02:54 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:02:54 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:02:54 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:02:54 user nova-compute[74582]:   </clock>
Nov 03 14:02:54 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:02:54 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:02:54 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:02:54 user nova-compute[74582]:   </cpu>
Nov 03 14:02:54 user nova-compute[74582]:   <devices>
Nov 03 14:02:54 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:02:54 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:02:54 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk"/>
Nov 03 14:02:54 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:02:54 user nova-compute[74582]:     </disk>
Nov 03 14:02:54 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:02:54 user nova-compute[74582]:       <mac address="fa:16:3e:2f:e4:54"/>
Nov 03 14:02:54 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:02:54 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:02:54 user nova-compute[74582]:       <target dev="tapeb5dbb6f-1c"/>
Nov 03 14:02:54 user nova-compute[74582]:     </interface>
Nov 03 14:02:54 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:02:54 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/console.log" append="off"/>
Nov 03 14:02:54 user nova-compute[74582]:     </serial>
Nov 03 14:02:54 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:02:54 user nova-compute[74582]:     <video>
Nov 03 14:02:54 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:02:54 user nova-compute[74582]:     </video>
Nov 03 14:02:54 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:02:54 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:02:54 user nova-compute[74582]:     </rng>
Nov 03 14:02:54 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:02:54 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:02:54 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:02:54 user nova-compute[74582]:     </memballoon>
Nov 03 14:02:54 user nova-compute[74582]:   </devices>
Nov 03 14:02:54 user nova-compute[74582]: </domain>
Nov 03 14:02:54 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687070852',display_name='tempest-TestMinimumBasicScenario-server-1687070852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687070852',id=31,image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXbt00hUhVjJka/8XJWIzVA/aV0ZDnlyeHXSd9zVxLtEsVmvJmpu5TbVD9WHOvl4YjmUhDJkjW/pJ/hjS/mkQ6NMOTQMBndodmqcfHsMdXZDdKQ16w9ZdlHzeY0+2GcTw==',key_name='tempest-TestMinimumBasicScenario-97236426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-g3b17wod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:02:52Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=1b594495-ee96-4a48-a789-ab1d14135410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG os_vif [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ea17f3b-8c0c-54c5-bf77-36efa011b7c2', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb5dbb6f-1c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb5dbb6f-1c, col_values=(('qos', UUID('11461843-f13c-440d-8372-4913df356caa')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb5dbb6f-1c, col_values=(('external_ids', {'iface-id': 'eb5dbb6f-1cf8-4b3a-a747-275e16d52d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e4:54', 'vm-uuid': '1b594495-ee96-4a48-a789-ab1d14135410'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:54 user nova-compute[74582]: INFO os_vif [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c')
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.neutron [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updated VIF entry in instance network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.network.neutron [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4394a0c3-d7c3-4831-bee7-faf1a259c97d req-09cb3955-6ade-436a-a4a8-047a25b7d541 service nova] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:02:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No VIF found with MAC fa:16:3e:2f:e4:54, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] No waiting events found dispatching network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:55 user nova-compute[74582]: WARNING nova.compute.manager [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received unexpected event network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 for instance with vm_state building and task_state spawning.
Nov 03 14:02:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] No waiting events found dispatching network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:55 user nova-compute[74582]: WARNING nova.compute.manager [req-4636aeb2-6fb5-4bfc-a91c-040fdf9fb4ae req-ec74618f-367e-4d98-82cd-b525feadefe5 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received unexpected event network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 for instance with vm_state building and task_state spawning.
Nov 03 14:02:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-08d01f6d-8cec-48bc-ad6f-2b51d5242bad req-ecd0fa4a-8539-43ff-8fbd-2e6d254ed80e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-08d01f6d-8cec-48bc-ad6f-2b51d5242bad req-ecd0fa4a-8539-43ff-8fbd-2e6d254ed80e service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-08d01f6d-8cec-48bc-ad6f-2b51d5242bad req-ecd0fa4a-8539-43ff-8fbd-2e6d254ed80e service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-08d01f6d-8cec-48bc-ad6f-2b51d5242bad req-ecd0fa4a-8539-43ff-8fbd-2e6d254ed80e service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-08d01f6d-8cec-48bc-ad6f-2b51d5242bad req-ecd0fa4a-8539-43ff-8fbd-2e6d254ed80e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:56 user nova-compute[74582]: WARNING nova.compute.manager [req-08d01f6d-8cec-48bc-ad6f-2b51d5242bad req-ecd0fa4a-8539-43ff-8fbd-2e6d254ed80e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state building and task_state spawning.
Nov 03 14:02:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:02:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:02:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Instance spawned successfully.
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: INFO nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Took 7.41 seconds to spawn the instance on the hypervisor.
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:02:58 user nova-compute[74582]: INFO nova.compute.manager [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Took 8.29 seconds to build instance.
Nov 03 14:02:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-294b25e9-03e2-43b1-8966-a25f8295918a tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.387s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-adbadad9-1646-44d4-a544-2716f3662506 req-9134d11f-ca45-4b11-9236-a038299477ae service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-adbadad9-1646-44d4-a544-2716f3662506 req-9134d11f-ca45-4b11-9236-a038299477ae service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-adbadad9-1646-44d4-a544-2716f3662506 req-9134d11f-ca45-4b11-9236-a038299477ae service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-adbadad9-1646-44d4-a544-2716f3662506 req-9134d11f-ca45-4b11-9236-a038299477ae service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-adbadad9-1646-44d4-a544-2716f3662506 req-9134d11f-ca45-4b11-9236-a038299477ae service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:02:58 user nova-compute[74582]: WARNING nova.compute.manager [req-adbadad9-1646-44d4-a544-2716f3662506 req-9134d11f-ca45-4b11-9236-a038299477ae service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state building and task_state spawning.
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:02:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance spawned successfully.
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:02:59 user nova-compute[74582]: INFO nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 03 14:02:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:02:59 user nova-compute[74582]: INFO nova.compute.manager [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Took 7.64 seconds to build instance.
Nov 03 14:02:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-119f5826-10e7-44e4-b577-12b00a9d9c20 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.790s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:02:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Updating instance_info_cache with network_info: [{"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-66414a19-4a63-4621-82f2-33d5c60769cc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:03:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:01 user nova-compute[74582]: INFO nova.virt.block_device [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Booting with volume 3dfd91ca-90c8-41f1-aee7-04884279fe9e at /dev/vdc
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:03:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Creating image(s)
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Ensure instance console log exists: /opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Start _get_guest_xml network_info=[{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4279f853-b3ae-4c42-b15b-cdee6f966f97', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce4dda5c-bd2b-4bce-9def-e076b5b2106a', 'attached_at': '', 'detached_at': '', 'volume_id': '42fa1d41-757f-4698-9f7f-b08067eb655b', 'serial': '42fa1d41-757f-4698-9f7f-b08067eb655b'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:03:01 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:03:01 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:01 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:01 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:01 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759f8d1-5355-4b19-8b5a-f3ad90ef39bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:03:01 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad35839-4a65-4514-be51-08f608e525c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b] added
Nov 03 14:03:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'flavor' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05d627-9c51-4b08-b601-f8b62263a875]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-38a4b5e5-8c45-4a9e-8df6-8505d86049aa tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.138s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[175cd003-5d1c-4ae1-9f55-0ebe766febe3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeDJzhFW {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeDJzhFW" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bef612b-1659-41cb-81f2-7e3843c7d154]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yeDJzhFW'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0587b7-f8b0-46a4-ab6d-e218a8c05644]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11e906-33ba-48d7-84c4-e443de55ed4f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[85964fdd-c739-4f58-a758-61eee7c5de15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c7a11-1a6c-453c-b86d-bcb91113fe01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a74069-1306-4444-bb2d-2a79c3f18bde]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e9ab6c-1ebf-42cf-a3fa-9144ab256886]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:03:01 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b47ced-fa80-4ee6-95c3-742de9e93988]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.utils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating existing volume attachment record: 081d94ae-7127-4947-8863-db6197caaa4c {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d83e6-28e1-4fa9-b1cd-5110ab67c71c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]
Nov 03 14:03:01 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.
Nov 03 14:03:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e95e9e-1083-4cd7-bacb-a90a251af9de]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a73a4b-2c19-4614-b8b8-4420fb7ba15f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:01 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd64f88-2543-4ffe-9e59-828f43882613]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:01 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26631623061383436', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631623061383436', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-232847620',display_name='tempest-TestShelveInstance-server-232847620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-232847620',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtMnTFblYCJsXQkmRLLKrlP9GSeiTmuxHzQtFofA2NymsPTQCbmZB/WPGMxwmEguhWqFjxcF7WBwINHWb0vnG/TROL/pZ491GaH3d5EtSQfiqUFM3yiRRYWvXqqn9EDpA==',key_name='tempest-TestShelveInstance-1970729209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9bce1e208f4b809df3cd71cccf1064',ramdisk_id='',reservation_id='r-mo0t1e8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1159972837',owner_user_name='tempest-TestShelveInstance-1159972837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:02:17Z,user_data=None,user_id='1b40b982348e4a42be1953ce067bd977',uuid=ce4dda5c-bd2b-4bce-9def-e076b5b2106a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converting VIF {"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'pci_devices' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:03:03 user nova-compute[74582]:   <uuid>ce4dda5c-bd2b-4bce-9def-e076b5b2106a</uuid>
Nov 03 14:03:03 user nova-compute[74582]:   <name>instance-0000001d</name>
Nov 03 14:03:03 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:03:03 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:03:03 user nova-compute[74582]:   <metadata>
Nov 03 14:03:03 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:03:03 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:03:03 user nova-compute[74582]:       <nova:name>tempest-TestShelveInstance-server-232847620</nova:name>
Nov 03 14:03:03 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:03:01</nova:creationTime>
Nov 03 14:03:03 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:03:03 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:03:03 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:03:03 user nova-compute[74582]:       <nova:owner>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:user uuid="1b40b982348e4a42be1953ce067bd977">tempest-TestShelveInstance-1159972837-project-member</nova:user>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:project uuid="bc9bce1e208f4b809df3cd71cccf1064">tempest-TestShelveInstance-1159972837</nova:project>
Nov 03 14:03:03 user nova-compute[74582]:       </nova:owner>
Nov 03 14:03:03 user nova-compute[74582]:       <nova:ports>
Nov 03 14:03:03 user nova-compute[74582]:         <nova:port uuid="b187fce7-d381-4707-8cc7-8b6497cdaacb">
Nov 03 14:03:03 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 14:03:03 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:03 user nova-compute[74582]:       </nova:ports>
Nov 03 14:03:03 user nova-compute[74582]:     </nova:instance>
Nov 03 14:03:03 user nova-compute[74582]:   </metadata>
Nov 03 14:03:03 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:03:03 user nova-compute[74582]:     <system>
Nov 03 14:03:03 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:03:03 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:03:03 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:03:03 user nova-compute[74582]:       <entry name="serial">ce4dda5c-bd2b-4bce-9def-e076b5b2106a</entry>
Nov 03 14:03:03 user nova-compute[74582]:       <entry name="uuid">ce4dda5c-bd2b-4bce-9def-e076b5b2106a</entry>
Nov 03 14:03:03 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:03:03 user nova-compute[74582]:     </system>
Nov 03 14:03:03 user nova-compute[74582]:   </sysinfo>
Nov 03 14:03:03 user nova-compute[74582]:   <os>
Nov 03 14:03:03 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:03:03 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:03:03 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:03:03 user nova-compute[74582]:   </os>
Nov 03 14:03:03 user nova-compute[74582]:   <features>
Nov 03 14:03:03 user nova-compute[74582]:     <acpi/>
Nov 03 14:03:03 user nova-compute[74582]:     <apic/>
Nov 03 14:03:03 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:03:03 user nova-compute[74582]:   </features>
Nov 03 14:03:03 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:03:03 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:03:03 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:03:03 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:03:03 user nova-compute[74582]:   </clock>
Nov 03 14:03:03 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:03:03 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:03:03 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:03:03 user nova-compute[74582]:   </cpu>
Nov 03 14:03:03 user nova-compute[74582]:   <devices>
Nov 03 14:03:03 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:03:03 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:03 user nova-compute[74582]:       <source dev="/dev/sdd"/>
Nov 03 14:03:03 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:03:03 user nova-compute[74582]:       <serial>42fa1d41-757f-4698-9f7f-b08067eb655b</serial>
Nov 03 14:03:03 user nova-compute[74582]:     </disk>
Nov 03 14:03:03 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:03 user nova-compute[74582]:       <mac address="fa:16:3e:4d:0e:56"/>
Nov 03 14:03:03 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:03 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:03 user nova-compute[74582]:       <target dev="tapb187fce7-d3"/>
Nov 03 14:03:03 user nova-compute[74582]:     </interface>
Nov 03 14:03:03 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:03:03 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a/console.log" append="off"/>
Nov 03 14:03:03 user nova-compute[74582]:     </serial>
Nov 03 14:03:03 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:03:03 user nova-compute[74582]:     <video>
Nov 03 14:03:03 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:03 user nova-compute[74582]:     </video>
Nov 03 14:03:03 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:03:03 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:03:03 user nova-compute[74582]:     </rng>
Nov 03 14:03:03 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:03:03 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:03:03 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:03:03 user nova-compute[74582]:     </memballoon>
Nov 03 14:03:03 user nova-compute[74582]:   </devices>
Nov 03 14:03:03 user nova-compute[74582]: </domain>
Nov 03 14:03:03 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-232847620',display_name='tempest-TestShelveInstance-server-232847620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-232847620',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtMnTFblYCJsXQkmRLLKrlP9GSeiTmuxHzQtFofA2NymsPTQCbmZB/WPGMxwmEguhWqFjxcF7WBwINHWb0vnG/TROL/pZ491GaH3d5EtSQfiqUFM3yiRRYWvXqqn9EDpA==',key_name='tempest-TestShelveInstance-1970729209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9bce1e208f4b809df3cd71cccf1064',ramdisk_id='',reservation_id='r-mo0t1e8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1159972837',owner_user_name='tempest-TestShelveInstance-1159972837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:02:17Z,user_data=None,user_id='1b40b982348e4a42be1953ce067bd977',uuid=ce4dda5c-bd2b-4bce-9def-e076b5b2106a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converting VIF {"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG os_vif [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a88c7a63-3835-5321-819d-d956c11b2847', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb187fce7-d3, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb187fce7-d3, col_values=(('qos', UUID('ea2ece52-0d63-45ef-9abd-713610924b1f')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb187fce7-d3, col_values=(('external_ids', {'iface-id': 'b187fce7-d381-4707-8cc7-8b6497cdaacb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:0e:56', 'vm-uuid': 'ce4dda5c-bd2b-4bce-9def-e076b5b2106a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:03 user nova-compute[74582]: INFO os_vif [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3')
Nov 03 14:03:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:03:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] No VIF found with MAC fa:16:3e:4d:0e:56, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-c7c8cc37-1659-4456-bc44-c10ba59b5e5d req-68236fbb-6fdf-4981-9867-ddf4243de940 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c7c8cc37-1659-4456-bc44-c10ba59b5e5d req-68236fbb-6fdf-4981-9867-ddf4243de940 service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c7c8cc37-1659-4456-bc44-c10ba59b5e5d req-68236fbb-6fdf-4981-9867-ddf4243de940 service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c7c8cc37-1659-4456-bc44-c10ba59b5e5d req-68236fbb-6fdf-4981-9867-ddf4243de940 service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-c7c8cc37-1659-4456-bc44-c10ba59b5e5d req-68236fbb-6fdf-4981-9867-ddf4243de940 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:05 user nova-compute[74582]: WARNING nova.compute.manager [req-c7c8cc37-1659-4456-bc44-c10ba59b5e5d req-68236fbb-6fdf-4981-9867-ddf4243de940 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state building and task_state spawning.
Nov 03 14:03:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:05 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-c20cac12-e0f5-4d39-b30f-df459f0a7444 req-63cb0702-dabe-4315-a49b-573d5abceedd service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c20cac12-e0f5-4d39-b30f-df459f0a7444 req-63cb0702-dabe-4315-a49b-573d5abceedd service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c20cac12-e0f5-4d39-b30f-df459f0a7444 req-63cb0702-dabe-4315-a49b-573d5abceedd service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c20cac12-e0f5-4d39-b30f-df459f0a7444 req-63cb0702-dabe-4315-a49b-573d5abceedd service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-c20cac12-e0f5-4d39-b30f-df459f0a7444 req-63cb0702-dabe-4315-a49b-573d5abceedd service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:07 user nova-compute[74582]: WARNING nova.compute.manager [req-c20cac12-e0f5-4d39-b30f-df459f0a7444 req-63cb0702-dabe-4315-a49b-573d5abceedd service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state building and task_state spawning.
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:03:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance spawned successfully.
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:07 user nova-compute[74582]: INFO nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 03 14:03:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:07 user nova-compute[74582]: INFO nova.compute.manager [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Took 51.24 seconds to build instance.
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c3e7a703-e7de-4b44-bd3c-4ca5bd36a830 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.339s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:03:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:03:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:03:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:03:09 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.101390838623047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:03:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance defe453f-2cfb-43e0-9e1f-9f5223258982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bfd1deec-6150-47c0-b319-02754d07e077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9e9b61ac-1001-4da7-8478-7c5665ad112a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ce4dda5c-bd2b-4bce-9def-e076b5b2106a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a967ee46-aa7b-4667-8b6d-54c4c3b0bae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1b594495-ee96-4a48-a789-ab1d14135410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.149s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:03:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:22 user nova-compute[74582]: INFO nova.compute.manager [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Unrescuing
Nov 03 14:03:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:03:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquired lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:03:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating instance_info_cache with network_info: [{"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Releasing lock "refresh_cache-bfd1deec-6150-47c0-b319-02754d07e077" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'flavor' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-612ce317-f2d8-4943-81a3-83f22cce5e88 req-1c27d3e0-2ec2-4f54-b511-899e4e34a3b4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-612ce317-f2d8-4943-81a3-83f22cce5e88 req-1c27d3e0-2ec2-4f54-b511-899e4e34a3b4 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-612ce317-f2d8-4943-81a3-83f22cce5e88 req-1c27d3e0-2ec2-4f54-b511-899e4e34a3b4 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-612ce317-f2d8-4943-81a3-83f22cce5e88 req-1c27d3e0-2ec2-4f54-b511-899e4e34a3b4 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-612ce317-f2d8-4943-81a3-83f22cce5e88 req-1c27d3e0-2ec2-4f54-b511-899e4e34a3b4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:23 user nova-compute[74582]: WARNING nova.compute.manager [req-612ce317-f2d8-4943-81a3-83f22cce5e88 req-1c27d3e0-2ec2-4f54-b511-899e4e34a3b4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:03:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance destroyed successfully.
Nov 03 14:03:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-74390e0d-2134-4282-89b9-f24877ebd23a req-e3d02720-4056-4406-9d07-8f4580845264 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-74390e0d-2134-4282-89b9-f24877ebd23a req-e3d02720-4056-4406-9d07-8f4580845264 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-74390e0d-2134-4282-89b9-f24877ebd23a req-e3d02720-4056-4406-9d07-8f4580845264 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-74390e0d-2134-4282-89b9-f24877ebd23a req-e3d02720-4056-4406-9d07-8f4580845264 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-74390e0d-2134-4282-89b9-f24877ebd23a req-e3d02720-4056-4406-9d07-8f4580845264 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:25 user nova-compute[74582]: WARNING nova.compute.manager [req-74390e0d-2134-4282-89b9-f24877ebd23a req-e3d02720-4056-4406-9d07-8f4580845264 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:03:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:26 user nova-compute[74582]: INFO nova.compute.manager [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] [instance: 9e9b61ac-1001-4da7-8478-7c5665ad112a] Took 41.77 seconds to detach 3 volumes for instance.
Nov 03 14:03:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:26 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:03:26 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:27 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Deleted allocations for instance 9e9b61ac-1001-4da7-8478-7c5665ad112a
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:03:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Creating image(s)
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Ensure instance console log exists: /opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Start _get_guest_xml network_info=[{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3b21e186-d706-4ee7-b0f5-e33918b809df', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxtrMZdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0', 'attached_at': '', 'detached_at': '', 'volume_id': 'da79b803-1ea8-486a-bfa7-b5f67af6797a', 'serial': 'da79b803-1ea8-486a-bfa7-b5f67af6797a'}, 'volume_type': None}, {'attachment_id': 'ce929239-5c48-406f-adac-f836f55abb71', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIMSxhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0', 'attached_at': '', 'detached_at': '', 'volume_id': '71cf17db-364c-44e4-be49-5d4464d30fe2', 'serial': '71cf17db-364c-44e4-be49-5d4464d30fe2'}, 'volume_type': None}, {'attachment_id': '081d94ae-7127-4947-8863-db6197caaa4c', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwaClEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0', 'attached_at': '', 'detached_at': '', 'volume_id': '3dfd91ca-90c8-41f1-aee7-04884279fe9e', 'serial': '3dfd91ca-90c8-41f1-aee7-04884279fe9e'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:03:27 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:03:27 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxtrMZdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:27 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc1557-a444-4c27-b8d7-560bd755dd2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:03:27 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[532d0a5e-d89a-42ca-87d3-7af8a1ae3501]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a] added
Nov 03 14:03:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1ee616-373a-4f9f-a5ed-6ec8e72f9468]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-68bfd842-bc5a-4308-9689-0307b4baa15b tempest-TaggedBootDevicesTest_v242-125788020 tempest-TaggedBootDevicesTest_v242-125788020-project-member] Lock "9e9b61ac-1001-4da7-8478-7c5665ad112a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 50.829s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[33728fb0-1c8b-4c84-955b-af241dcc0366]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxtrMZdV {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxtrMZdV" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e198e17-b74f-4390-ad66-bd5dc1aaf229]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxtrMZdV'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a03d0e-127e-43fd-8d0f-642da584ee59]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[841be9eb-4082-4c1c-9134-7693cc242403]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c63de-fb93-46bd-8e58-217b7a0e42b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260]
Nov 03 14:03:27 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260] successful.
Nov 03 14:03:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNAyxKgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0fec38-1f4f-472e-90b8-c9ba2b9d3fc0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f152b-f527-46d7-9ea3-709dbc896a69]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:27 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86e9a6-597a-4766-b964-623a635f24cc]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxtrMZdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:27 user nova-compute[74582]: WARNING nova.compute.manager [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:27 user nova-compute[74582]: WARNING nova.compute.manager [req-b66f3e2e-86c1-4e1a-88ff-cc2b72349f6e req-164dc15d-4dff-4264-9959-69d34d826e23 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:03:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3ea5f192-5ffd-4cf2-a451-15f08cc7b130 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23330653639386232', 'path': '/dev/sde'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330653639386232', 'path': '/dev/sde'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.096s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:28 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:28 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4cb78-1501-48ab-973b-b60bf497152a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:03:28 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIMSxhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:28 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a815d6d3-f1f9-4832-9927-7527f3c7d8ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c] added
Nov 03 14:03:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a70667-b002-4b14-a319-72aa8913f309]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d930d668-427b-49dc-b7bf-ed2dfa0ea722]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNAyxKgr {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNAyxKgr" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed6061-da0e-4aa7-aae5-0a134a05c763]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNAyxKgr'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[321998b6-a982-4a84-bccb-c5f71ed55b4e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1493e3-2fa4-4668-8bf7-96da6984fd96]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee03c534-d529-4753-b26d-fc32e0414bbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260]
Nov 03 14:03:28 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260] successful.
Nov 03 14:03:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8c7f0-bc5c-482b-bd91-5ed16991773f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68931e0-5bf6-4834-8467-2e36c270eba2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:28 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[245d38ca-a074-4e26-b558-11e8457aa34b]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:03:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNAyxKgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== connect_volume: return (2484ms) {'type': 'block', 'scsi_wwn': '26561373035653335', 'path': '/dev/sdf'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561373035653335', 'path': '/dev/sdf'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.346s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:29 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:29 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:03:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[60817d6e-193d-4ca2-b4b5-325a2c682bae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:03:29 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:03:30 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:30 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 14:03:30 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 14:03:30 user nova-compute[74582]:   <serial>66ec6c76-18f4-4ce6-92bc-e527d09aa09c</serial>
Nov 03 14:03:30 user nova-compute[74582]: </disk>
Nov 03 14:03:30 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934e85d-a352-4367-a72f-cf712c0446ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2] added
Nov 03 14:03:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9700e3a-c6a8-49d4-9eb7-e59ae20f6cc8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[da10ebc4-e5f1-4a7c-bc91-aa7087a61178]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDIMSxhy {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDIMSxhy" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3ac27a-a8d9-4112-be44-71df462019a0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fDIMSxhy'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cbdb7-a2a0-4fb8-91e7-e17c80f1be79]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7cc1f-63dc-4aee-9f22-7044f4c08a30]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b977158-fd00-41f0-bdc2-9a83ca05684e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260]
Nov 03 14:03:30 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260] successful.
Nov 03 14:03:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e81712-f99c-44f1-a295-0812d4186502]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[92339b6a-b67f-4598-875f-46551622d481]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:30 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddfe167-24eb-4777-b292-1c69a4e70f35]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIMSxhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:03:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] No VIF found with MAC fa:16:3e:67:ae:69, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8f808b7-200b-46b6-a0ad-c8a412da1671 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.749s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== connect_volume: return (2873ms) {'type': 'block', 'scsi_wwn': '23135373862663832', 'path': '/dev/sdh'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135373862663832', 'path': '/dev/sdh'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwaClEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:31 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:31 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:31 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7cbcc2-9cf0-4570-8e18-d60eaea05e50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:03:31 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b75787-c546-47df-bd7c-23d8c7bb8c7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e] added
Nov 03 14:03:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c771a452-04a2-4af4-ba4e-9b405e63012f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d467cfaa-400b-46f5-a7b8-c3877a46b856]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwaClEBc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwaClEBc" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7037e5a-7885-4d16-97bf-d807012e0882]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YwaClEBc'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7454c0-dad3-43cb-827d-5148b7b92590]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2e51d-41d7-406f-b105-9698802b0340]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea4d79-b562-4a04-97d1-6cc6856b7bc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260]
Nov 03 14:03:31 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260] successful.
Nov 03 14:03:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d7bf4-1054-4a64-af5a-bc1cf230b467]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d03edb-5c19-46e2-a95f-3699fc882914]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:03:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:31 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:03:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] HCTL ('40', '-', '-', 0) found on session 36 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd294dd7-f252-4505-9466-ed83cc13d879]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Searching for a device in session 36 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:03:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwaClEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:03:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:32 user nova-compute[74582]: INFO nova.compute.manager [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Detaching volume fc5d15b9-202d-4fce-b763-2e6e297152f0
Nov 03 14:03:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23764386535303336', 'path': '/dev/sdi'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764386535303336', 'path': '/dev/sdi'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lazy-loading 'pci_devices' on Instance uuid 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:03:33 user nova-compute[74582]:   <uuid>345a0ccc-0e2a-45a9-8cc3-a30865db79d0</uuid>
Nov 03 14:03:33 user nova-compute[74582]:   <name>instance-0000001c</name>
Nov 03 14:03:33 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:03:33 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:03:33 user nova-compute[74582]:   <metadata>
Nov 03 14:03:33 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:03:33 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:03:33 user nova-compute[74582]:       <nova:name>tempest-device-tagging-server-1180745369</nova:name>
Nov 03 14:03:33 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:03:27</nova:creationTime>
Nov 03 14:03:33 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:03:33 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:03:33 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:03:33 user nova-compute[74582]:       <nova:owner>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:user uuid="54ff58b22a904574bfb6e4f92af5226d">tempest-TaggedBootDevicesTest-384199897-project-member</nova:user>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:project uuid="938cabd29d654edc94cac90c27adf1fb">tempest-TaggedBootDevicesTest-384199897</nova:project>
Nov 03 14:03:33 user nova-compute[74582]:       </nova:owner>
Nov 03 14:03:33 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:03:33 user nova-compute[74582]:       <nova:ports>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="63344b70-dfc1-4bef-bead-ed43f9644d32">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="6a027b3c-1b58-4d5d-b013-458053df7acd">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="a047da4c-eb2d-487d-87b9-e9c33222ec92">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="37b06a2c-20d9-48ff-995f-0404c8cfcb21">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="c249a4b1-0d9c-4103-9177-de45f2c2d0c4">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="634c9379-cbad-4756-9413-c0bf8b578acd">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:         <nova:port uuid="8c8000a0-4ebd-40a8-ba7f-6149580aabb9">
Nov 03 14:03:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 14:03:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:03:33 user nova-compute[74582]:       </nova:ports>
Nov 03 14:03:33 user nova-compute[74582]:     </nova:instance>
Nov 03 14:03:33 user nova-compute[74582]:   </metadata>
Nov 03 14:03:33 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:03:33 user nova-compute[74582]:     <system>
Nov 03 14:03:33 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:03:33 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:03:33 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:03:33 user nova-compute[74582]:       <entry name="serial">345a0ccc-0e2a-45a9-8cc3-a30865db79d0</entry>
Nov 03 14:03:33 user nova-compute[74582]:       <entry name="uuid">345a0ccc-0e2a-45a9-8cc3-a30865db79d0</entry>
Nov 03 14:03:33 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:03:33 user nova-compute[74582]:     </system>
Nov 03 14:03:33 user nova-compute[74582]:   </sysinfo>
Nov 03 14:03:33 user nova-compute[74582]:   <os>
Nov 03 14:03:33 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:03:33 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:03:33 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:03:33 user nova-compute[74582]:   </os>
Nov 03 14:03:33 user nova-compute[74582]:   <features>
Nov 03 14:03:33 user nova-compute[74582]:     <acpi/>
Nov 03 14:03:33 user nova-compute[74582]:     <apic/>
Nov 03 14:03:33 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:03:33 user nova-compute[74582]:   </features>
Nov 03 14:03:33 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:03:33 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:03:33 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:03:33 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:03:33 user nova-compute[74582]:   </clock>
Nov 03 14:03:33 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:03:33 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:03:33 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:03:33 user nova-compute[74582]:   </cpu>
Nov 03 14:03:33 user nova-compute[74582]:   <devices>
Nov 03 14:03:33 user nova-compute[74582]:     <disk type="file" device="cdrom">
Nov 03 14:03:33 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 14:03:33 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0/disk.config"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="hda" bus="ide"/>
Nov 03 14:03:33 user nova-compute[74582]:     </disk>
Nov 03 14:03:33 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:03:33 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:33 user nova-compute[74582]:       <source dev="/dev/sde"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <serial>da79b803-1ea8-486a-bfa7-b5f67af6797a</serial>
Nov 03 14:03:33 user nova-compute[74582]:     </disk>
Nov 03 14:03:33 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:03:33 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:33 user nova-compute[74582]:       <source dev="/dev/sdh"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <serial>71cf17db-364c-44e4-be49-5d4464d30fe2</serial>
Nov 03 14:03:33 user nova-compute[74582]:     </disk>
Nov 03 14:03:33 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:03:33 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:33 user nova-compute[74582]:       <source dev="/dev/sdi"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="vdc" bus="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <serial>3dfd91ca-90c8-41f1-aee7-04884279fe9e</serial>
Nov 03 14:03:33 user nova-compute[74582]:     </disk>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:c3:7b:72"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tap63344b70-df"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:58:15:04"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tap6a027b3c-1b"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:f3:0b:28"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tapa047da4c-eb"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:cc:d4:a6"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tap37b06a2c-20"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:e5:cb:46"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tapc249a4b1-0d"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:53:4b:c0"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tap634c9379-cb"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:03:33 user nova-compute[74582]:       <mac address="fa:16:3e:b9:84:2e"/>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:03:33 user nova-compute[74582]:       <target dev="tap8c8000a0-4e"/>
Nov 03 14:03:33 user nova-compute[74582]:     </interface>
Nov 03 14:03:33 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:03:33 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0/console.log" append="off"/>
Nov 03 14:03:33 user nova-compute[74582]:     </serial>
Nov 03 14:03:33 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:03:33 user nova-compute[74582]:     <video>
Nov 03 14:03:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:     </video>
Nov 03 14:03:33 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:03:33 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:03:33 user nova-compute[74582]:     </rng>
Nov 03 14:03:33 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:03:33 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:03:33 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:03:33 user nova-compute[74582]:     </memballoon>
Nov 03 14:03:33 user nova-compute[74582]:   </devices>
Nov 03 14:03:33 user nova-compute[74582]: </domain>
Nov 03 14:03:33 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f894721b-b302-5598-a61a-8a9e20163b37', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63344b70-df, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63344b70-df, col_values=(('qos', UUID('5d3a83e8-39fc-4bd8-a77a-29fa6e3f4c5c')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63344b70-df, col_values=(('external_ids', {'iface-id': '63344b70-dfc1-4bef-bead-ed43f9644d32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:7b:72', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: INFO nova.virt.block_device [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attempting to driver detach volume fc5d15b9-202d-4fce-b763-2e6e297152f0 from mountpoint /dev/vdb
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c9a7510-4ca0-5219-9be0-281b81afd657', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Attempting to detach device vdb from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:03:33 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:33 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 14:03:33 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:   <serial>fc5d15b9-202d-4fce-b763-2e6e297152f0</serial>
Nov 03 14:03:33 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:03:33 user nova-compute[74582]: </disk>
Nov 03 14:03:33 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a027b3c-1b, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a027b3c-1b, col_values=(('qos', UUID('a20868a4-cb03-41cb-ac07-7ce5f2e364fe')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a027b3c-1b, col_values=(('external_ids', {'iface-id': '6a027b3c-1b58-4d5d-b013-458053df7acd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:15:04', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully detached device vdb from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the persistent domain config.
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:03:33 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:33 user nova-compute[74582]:   <source dev="/dev/sdg"/>
Nov 03 14:03:33 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:03:33 user nova-compute[74582]:   <serial>fc5d15b9-202d-4fce-b763-2e6e297152f0</serial>
Nov 03 14:03:33 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:03:33 user nova-compute[74582]: </disk>
Nov 03 14:03:33 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfa20cb0-cf00-54a1-b7e7-a45a7ebeaca0', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa047da4c-eb, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa047da4c-eb, col_values=(('qos', UUID('6ab6eb98-be08-43c1-854f-a048da20ffbb')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa047da4c-eb, col_values=(('external_ids', {'iface-id': 'a047da4c-eb2d-487d-87b9-e9c33222ec92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:0b:28', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '377c03b8-8001-580a-9f43-edc7ef30c8e4', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37b06a2c-20, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37b06a2c-20, col_values=(('qos', UUID('c677308f-ed9c-4076-86b8-927c14fbbb9c')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37b06a2c-20, col_values=(('external_ids', {'iface-id': '37b06a2c-20d9-48ff-995f-0404c8cfcb21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:d4:a6', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9727d5b2-90f8-5476-9ed9-dfd7a5778d87', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc249a4b1-0d, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc249a4b1-0d, col_values=(('qos', UUID('448d3d59-bf78-47e6-b70c-756f0ff4f9ad')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc249a4b1-0d, col_values=(('external_ids', {'iface-id': 'c249a4b1-0d9c-4103-9177-de45f2c2d0c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:cb:46', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eacccb12-ab7d-56da-a5db-d2f815f28b12', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap634c9379-cb, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap634c9379-cb, col_values=(('qos', UUID('2e7201ae-57fe-4d36-9e21-2c885df60abf')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap634c9379-cb, col_values=(('external_ids', {'iface-id': '634c9379-cbad-4756-9413-c0bf8b578acd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:4b:c0', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9810cf29-9078-56b4-8905-b63423cc4567', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8000a0-4e, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c8000a0-4e, col_values=(('qos', UUID('953a01ed-a872-4cda-8577-ac5df54e6aa2')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c8000a0-4e, col_values=(('external_ids', {'iface-id': '8c8000a0-4ebd-40a8-ba7f-6149580aabb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:84:2e', 'vm-uuid': '345a0ccc-0e2a-45a9-8cc3-a30865db79d0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:33 user nova-compute[74582]: INFO os_vif [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e')
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] No BDM found with device name hda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] No VIF found with MAC fa:16:3e:c3:7b:72, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:03:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] No VIF found with MAC fa:16:3e:e5:cb:46, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:03:33 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Using config drive
Nov 03 14:03:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:34 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Creating config drive at /opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0/disk.config
Nov 03 14:03:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr43gsid1 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr43gsid1" returned: 0 in 0.059s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-7e51b5b0-56c5-41de-a7b2-d09e945bcd34 req-c516eab1-4696-4425-9125-f5f5bbc35a74 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7e51b5b0-56c5-41de-a7b2-d09e945bcd34 req-c516eab1-4696-4425-9125-f5f5bbc35a74 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7e51b5b0-56c5-41de-a7b2-d09e945bcd34 req-c516eab1-4696-4425-9125-f5f5bbc35a74 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7e51b5b0-56c5-41de-a7b2-d09e945bcd34 req-c516eab1-4696-4425-9125-f5f5bbc35a74 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-7e51b5b0-56c5-41de-a7b2-d09e945bcd34 req-c516eab1-4696-4425-9125-f5f5bbc35a74 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:36 user nova-compute[74582]: WARNING nova.compute.manager [req-7e51b5b0-56c5-41de-a7b2-d09e945bcd34 req-c516eab1-4696-4425-9125-f5f5bbc35a74 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 for instance with vm_state building and task_state spawning.
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebe23b98-a502-453a-b098-97c14256768d req-3964a200-dbab-45f8-ae4d-5e4d7640768b service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebe23b98-a502-453a-b098-97c14256768d req-3964a200-dbab-45f8-ae4d-5e4d7640768b service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebe23b98-a502-453a-b098-97c14256768d req-3964a200-dbab-45f8-ae4d-5e4d7640768b service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ebe23b98-a502-453a-b098-97c14256768d req-3964a200-dbab-45f8-ae4d-5e4d7640768b service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-ebe23b98-a502-453a-b098-97c14256768d req-3964a200-dbab-45f8-ae4d-5e4d7640768b service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:36 user nova-compute[74582]: WARNING nova.compute.manager [req-ebe23b98-a502-453a-b098-97c14256768d req-3964a200-dbab-45f8-ae4d-5e4d7640768b service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd for instance with vm_state building and task_state spawning.
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-cb616d0e-8d20-4ad3-867f-1c61f4548d72 req-aea1d7da-d715-4f82-8f04-45739ad7baa8 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb616d0e-8d20-4ad3-867f-1c61f4548d72 req-aea1d7da-d715-4f82-8f04-45739ad7baa8 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb616d0e-8d20-4ad3-867f-1c61f4548d72 req-aea1d7da-d715-4f82-8f04-45739ad7baa8 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cb616d0e-8d20-4ad3-867f-1c61f4548d72 req-aea1d7da-d715-4f82-8f04-45739ad7baa8 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-cb616d0e-8d20-4ad3-867f-1c61f4548d72 req-aea1d7da-d715-4f82-8f04-45739ad7baa8 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-cb616d0e-8d20-4ad3-867f-1c61f4548d72 req-aea1d7da-d715-4f82-8f04-45739ad7baa8 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 66414a19-4a63-4621-82f2-33d5c60769cc {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid a967ee46-aa7b-4667-8b6d-54c4c3b0bae1 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid c872e44a-e815-4f43-bbea-867d7a189c2e {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "da0950d0-3380-4104-8dca-023612958b01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "66414a19-4a63-4621-82f2-33d5c60769cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "bfd1deec-6150-47c0-b319-02754d07e077" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-eb9cc3ef-6928-4e97-918a-9a8f1def7b89 req-c37032fc-9956-4fac-a096-47d5a515406d service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 for instance with vm_state building and task_state spawning.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "da0950d0-3380-4104-8dca-023612958b01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "bfd1deec-6150-47c0-b319-02754d07e077" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.174s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "66414a19-4a63-4621-82f2-33d5c60769cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: INFO nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.185s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.182s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.206s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.260s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-3400049b-a992-42b4-aade-716030cbb4dd req-d0cfcebb-0ade-40b2-a0d1-7fd770d564cd service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3400049b-a992-42b4-aade-716030cbb4dd req-d0cfcebb-0ade-40b2-a0d1-7fd770d564cd service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3400049b-a992-42b4-aade-716030cbb4dd req-d0cfcebb-0ade-40b2-a0d1-7fd770d564cd service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3400049b-a992-42b4-aade-716030cbb4dd req-d0cfcebb-0ade-40b2-a0d1-7fd770d564cd service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-3400049b-a992-42b4-aade-716030cbb4dd req-d0cfcebb-0ade-40b2-a0d1-7fd770d564cd service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:38 user nova-compute[74582]: WARNING nova.compute.manager [req-3400049b-a992-42b4-aade-716030cbb4dd req-d0cfcebb-0ade-40b2-a0d1-7fd770d564cd service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd for instance with vm_state building and task_state spawning.
Nov 03 14:03:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:40 user nova-compute[74582]: WARNING nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd for instance with vm_state building and task_state spawning.
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:40 user nova-compute[74582]: WARNING nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 for instance with vm_state building and task_state spawning.
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:03:40 user nova-compute[74582]: WARNING nova.compute.manager [req-6ce03a6e-c717-4843-9872-58349fe08bd7 req-c007c2d4-953b-4f4e-b7ad-44cae57fb137 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 for instance with vm_state building and task_state spawning.
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:03:40 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance spawned successfully.
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:03:40 user nova-compute[74582]: INFO nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Took 13.80 seconds to spawn the instance on the hypervisor.
Nov 03 14:03:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:03:41 user nova-compute[74582]: INFO nova.compute.manager [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Took 113.41 seconds to build instance.
Nov 03 14:03:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8286bdd-615f-4ac9-84ed-553f389cfa0b tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 113.558s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.584s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:41 user nova-compute[74582]: INFO nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 03 14:03:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:53 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance defe453f-2cfb-43e0-9e1f-9f5223258982 is timed out.
Nov 03 14:03:53 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully detached device vdb from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the live domain config.
Nov 03 14:03:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKstBIue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:03:53 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec9042-235a-4b23-8994-63e3126bc36c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:03:53 user nova-compute[74582]: No targets found.
Nov 03 14:03:53 user nova-compute[74582]: iSNS:
Nov 03 14:03:53 user nova-compute[74582]: No targets found.
Nov 03 14:03:53 user nova-compute[74582]: STATIC:
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:03:53 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:03:53 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:03:53 user nova-compute[74582]: FIRMWARE:
Nov 03 14:03:53 user nova-compute[74582]: No targets found.
Nov 03 14:03:53 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:03:53 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:03:53 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[589571cf-7bd1-4c87-8da8-25044ef1fd0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f007cee-a2ef-4e0a-a9ee-460efdf2aa13]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:03:53 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:03:53 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:03:53 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f6861bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0'): ({'sdg'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Removing single pathed devices sdg {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[65012de2-4ba6-4559-9b11-85c735af4331]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a45db-5a47-4054-8057-daac3f75c61a]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flushing IO for device /dev/sdg {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae136359-7ec1-4a83-8e50-3ac0b606d89b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8789bb-8ea9-4fbf-b060-ffd26ad1303b]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] SCSI volumes sdg have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e5adc-e9a1-4724-a93f-d4fcc513ab8c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76808c5-8bd1-4875-9f0a-45b13e086026]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260]
Nov 03 14:03:54 user nova-compute[74582]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0, portal: 172.16.0.220,3260] successful.
Nov 03 14:03:54 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc5d15b9-202d-4fce-b763-2e6e297152f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa2516-ff68-4ff7-8d4a-9bf80d4cad8e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== disconnect_volume: return (412ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:03:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:03:55 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:03:56 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:03:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9bd5333c-4711-4817-9bc2-f886b312daf6 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.036s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.446s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:03:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:03:58 user nova-compute[74582]: INFO nova.compute.manager [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Detaching volume 66ec6c76-18f4-4ce6-92bc-e527d09aa09c
Nov 03 14:03:58 user nova-compute[74582]: INFO nova.virt.block_device [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Attempting to driver detach volume 66ec6c76-18f4-4ce6-92bc-e527d09aa09c from mountpoint /dev/vdc
Nov 03 14:03:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Attempting to detach device vdc from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:03:58 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:58 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 14:03:58 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 14:03:58 user nova-compute[74582]:   <serial>66ec6c76-18f4-4ce6-92bc-e527d09aa09c</serial>
Nov 03 14:03:58 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 14:03:58 user nova-compute[74582]: </disk>
Nov 03 14:03:58 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:03:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully detached device vdc from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the persistent domain config.
Nov 03 14:03:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:03:58 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:03:58 user nova-compute[74582]:   <source dev="/dev/sdf"/>
Nov 03 14:03:58 user nova-compute[74582]:   <target dev="vdc" bus="virtio"/>
Nov 03 14:03:58 user nova-compute[74582]:   <serial>66ec6c76-18f4-4ce6-92bc-e527d09aa09c</serial>
Nov 03 14:03:58 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 14:03:58 user nova-compute[74582]: </disk>
Nov 03 14:03:58 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:03:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:02 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:04:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:04:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:04:02 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:04:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:04:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:04:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:04:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:04:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:04:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:04:09 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.032958984375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:04:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance defe453f-2cfb-43e0-9e1f-9f5223258982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bfd1deec-6150-47c0-b319-02754d07e077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ce4dda5c-bd2b-4bce-9def-e076b5b2106a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a967ee46-aa7b-4667-8b6d-54c4c3b0bae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1b594495-ee96-4a48-a789-ab1d14135410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:04:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:18 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance defe453f-2cfb-43e0-9e1f-9f5223258982 is timed out.
Nov 03 14:04:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully detached device vdc from instance defe453f-2cfb-43e0-9e1f-9f5223258982 from the live domain config.
Nov 03 14:04:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNAyxKgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:04:18 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3a2058-5c36-41e6-ba1d-89fee07acb66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:04:18 user nova-compute[74582]: No targets found.
Nov 03 14:04:18 user nova-compute[74582]: iSNS:
Nov 03 14:04:18 user nova-compute[74582]: No targets found.
Nov 03 14:04:18 user nova-compute[74582]: STATIC:
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:04:18 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:04:18 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:04:18 user nova-compute[74582]: FIRMWARE:
Nov 03 14:04:18 user nova-compute[74582]: No targets found.
Nov 03 14:04:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:04:18 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:04:18 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edcc07c-934e-4dea-a50d-267aaa96f2eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f31330e-8505-4fa6-8351-5500db148d54]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:04:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:04:18 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:04:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68723250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c'): ({'sdf'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Removing single pathed devices sdf {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998f60e-4fea-4d5c-b974-6b1faf1c5249]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab5891-13bb-4774-a2d9-b2412615d988]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Flushing IO for device /dev/sdf {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[776cdac9-89d3-462e-859b-5ca8cbb2bf12]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b5b47b-315e-48d3-ad82-9b82ed15a8d7]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] SCSI volumes sdf have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2224a-8e41-4d78-a48b-9a5079f2676a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b406b7-9898-4e12-b6b0-de8d5eb7e6c9]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260]
Nov 03 14:04:18 user nova-compute[74582]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c, portal: 172.16.0.220,3260] successful.
Nov 03 14:04:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:04:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ec6c76-18f4-4ce6-92bc-e527d09aa09c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[74842682-2d27-4718-a451-53cf4db4a0fa]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:04:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:04:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] <== disconnect_volume: return (352ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:04:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:04:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'flavor' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:04:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a83b88ef-8feb-4576-b9d0-66247f516419 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.165s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:21 user nova-compute[74582]: INFO nova.compute.manager [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Terminating instance
Nov 03 14:04:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-adfac594-3ef8-49ca-903c-e5a7669e07f1 req-8220d1a3-b932-4225-8aba-35d0c3b6ffad service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-vif-unplugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-adfac594-3ef8-49ca-903c-e5a7669e07f1 req-8220d1a3-b932-4225-8aba-35d0c3b6ffad service nova] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-adfac594-3ef8-49ca-903c-e5a7669e07f1 req-8220d1a3-b932-4225-8aba-35d0c3b6ffad service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-adfac594-3ef8-49ca-903c-e5a7669e07f1 req-8220d1a3-b932-4225-8aba-35d0c3b6ffad service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-adfac594-3ef8-49ca-903c-e5a7669e07f1 req-8220d1a3-b932-4225-8aba-35d0c3b6ffad service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] No waiting events found dispatching network-vif-unplugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:04:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-adfac594-3ef8-49ca-903c-e5a7669e07f1 req-8220d1a3-b932-4225-8aba-35d0c3b6ffad service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-vif-unplugged-5ef92fe0-5804-4f9d-9633-2130066b3030 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:04:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Instance destroyed successfully.
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lazy-loading 'resources' on Instance uuid defe453f-2cfb-43e0-9e1f-9f5223258982 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2082366770',display_name='tempest-AttachVolumeTestJSON-server-2082366770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2082366770',id=25,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwInQcKOaUJvTmlxyrJMb0cOJ3iqzx3ou+v7kXAe/CqJj1EdMau/0ry4C7M91zffwa7EHaWinDa1YUTL5/DthQmVt1Fabo8cet31/Pyij1d3yPJSQ+Mzx4aS1gutpbhaQ==',key_name='tempest-keypair-1462614157',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='867ccc345ce547daa6a83fe5f13c74b7',ramdisk_id='',reservation_id='r-hk6a8339',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-331837995',owner_user_name='tempest-AttachVolumeTestJSON-331837995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee2e8967900436e874e86e6dd64ce72',uuid=defe453f-2cfb-43e0-9e1f-9f5223258982,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converting VIF {"id": "5ef92fe0-5804-4f9d-9633-2130066b3030", "address": "fa:16:3e:67:ae:69", "network": {"id": "3408da77-4e0e-48aa-b39f-3904909b8117", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1388786891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "867ccc345ce547daa6a83fe5f13c74b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef92fe0-58", "ovs_interfaceid": "5ef92fe0-5804-4f9d-9633-2130066b3030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG os_vif [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef92fe0-58, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b299346f-43bc-40de-be7e-817d75354856) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:22 user nova-compute[74582]: INFO os_vif [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:ae:69,bridge_name='br-int',has_traffic_filtering=True,id=5ef92fe0-5804-4f9d-9633-2130066b3030,network=Network(3408da77-4e0e-48aa-b39f-3904909b8117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef92fe0-58')
Nov 03 14:04:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Deleting instance files /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982_del
Nov 03 14:04:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Deletion of /opt/stack/data/nova/instances/defe453f-2cfb-43e0-9e1f-9f5223258982_del complete
Nov 03 14:04:22 user nova-compute[74582]: INFO nova.compute.manager [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 14:04:22 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:04:22 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:04:23 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Took 0.88 seconds to deallocate network for instance.
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:23 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Deleted allocations for instance defe453f-2cfb-43e0-9e1f-9f5223258982
Nov 03 14:04:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] Acquiring lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] No waiting events found dispatching network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:04:23 user nova-compute[74582]: WARNING nova.compute.manager [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received unexpected event network-vif-plugged-5ef92fe0-5804-4f9d-9633-2130066b3030 for instance with vm_state deleted and task_state None.
Nov 03 14:04:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ca70a2f1-c368-4bde-a9ac-315c69aee77f req-90519c42-aff2-46c0-822d-a873ef665882 service nova] [instance: defe453f-2cfb-43e0-9e1f-9f5223258982] Received event network-vif-deleted-5ef92fe0-5804-4f9d-9633-2130066b3030 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:04:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e9ae4019-2d0f-491a-bec9-365b406378b2 tempest-AttachVolumeTestJSON-331837995 tempest-AttachVolumeTestJSON-331837995-project-member] Lock "defe453f-2cfb-43e0-9e1f-9f5223258982" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.558s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:04:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:04:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:04:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:04:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:04:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:04:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'flavor' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:48 user nova-compute[74582]: INFO nova.compute.manager [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Attaching volume b56d2602-8e5e-423c-96f5-5891b71c153f to /dev/vdb
Nov 03 14:04:48 user nova-compute[74582]: DEBUG os_brick.utils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fabbd-4e62-4618-9561-e9948d87414b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf00f4d2-5095-40fd-811c-60fe40da22e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c2e14-6695-48f7-b6e6-f47bbf65d14c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1e6953-d5bb-43c5-b23f-aeec7ee545bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:04:48 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:04:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0adfa3-4207-4d35-a642-a7cf842d6ba6]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG os_brick.utils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:04:48 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating existing volume attachment record: d0d40235-4a47-4186-af4c-c98e01fce7b4 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:04:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:04:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:04:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing instance network info cache due to event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:04:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:04:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:04:58 user nova-compute[74582]: DEBUG nova.network.neutron [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updated VIF entry in instance network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-238e89e4-d5d4-434d-a732-89f4a90dca20 req-92dbbc8f-994a-43b0-a74c-fe85fafa48fa service nova] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:04:59 user nova-compute[74582]: INFO nova.compute.manager [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Shelve offloading
Nov 03 14:04:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:04:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-45bd0fdd-8e1f-49c2-8723-9d6ee5f639c8 req-03a664ef-e34d-4931-835a-821bfb415f1d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-unplugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-45bd0fdd-8e1f-49c2-8723-9d6ee5f639c8 req-03a664ef-e34d-4931-835a-821bfb415f1d service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-45bd0fdd-8e1f-49c2-8723-9d6ee5f639c8 req-03a664ef-e34d-4931-835a-821bfb415f1d service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-45bd0fdd-8e1f-49c2-8723-9d6ee5f639c8 req-03a664ef-e34d-4931-835a-821bfb415f1d service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-45bd0fdd-8e1f-49c2-8723-9d6ee5f639c8 req-03a664ef-e34d-4931-835a-821bfb415f1d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-unplugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:00 user nova-compute[74582]: WARNING nova.compute.manager [req-45bd0fdd-8e1f-49c2-8723-9d6ee5f639c8 req-03a664ef-e34d-4931-835a-821bfb415f1d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-unplugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state active and task_state shelving.
Nov 03 14:05:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance destroyed successfully.
Nov 03 14:05:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:05:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance destroyed successfully.
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'resources' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-232847620',display_name='tempest-TestShelveInstance-server-232847620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-232847620',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtMnTFblYCJsXQkmRLLKrlP9GSeiTmuxHzQtFofA2NymsPTQCbmZB/WPGMxwmEguhWqFjxcF7WBwINHWb0vnG/TROL/pZ491GaH3d5EtSQfiqUFM3yiRRYWvXqqn9EDpA==',key_name='tempest-TestShelveInstance-1970729209',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc9bce1e208f4b809df3cd71cccf1064',ramdisk_id='',reservation_id='r-mo0t1e8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159972837',owner_user_name='tempest-TestShelveInstance-1159972837-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:07Z,user_data=None,user_id='1b40b982348e4a42be1953ce067bd977',uuid=ce4dda5c-bd2b-4bce-9def-e076b5b2106a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converting VIF {"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_vif [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing instance network info cache due to event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb187fce7-d3, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea2ece52-0d63-45ef-9abd-713610924b1f) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:01 user nova-compute[74582]: INFO os_vif [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3')
Nov 03 14:05:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:01 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd6f83-10f2-4a8c-b1b6-4bf4687cf998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:05:01 user nova-compute[74582]: No targets found.
Nov 03 14:05:01 user nova-compute[74582]: iSNS:
Nov 03 14:05:01 user nova-compute[74582]: No targets found.
Nov 03 14:05:01 user nova-compute[74582]: STATIC:
Nov 03 14:05:01 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2
Nov 03 14:05:01 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:01 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:01 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e
Nov 03 14:05:01 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:01 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:01 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b
Nov 03 14:05:01 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:01 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:01 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:05:01 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:01 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:01 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:05:01 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:01 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:01 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:05:01 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:01 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:01 user nova-compute[74582]: FIRMWARE:
Nov 03 14:05:01 user nova-compute[74582]: No targets found.
Nov 03 14:05:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:05:01 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:05:01 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965e78e-c8d5-440a-8050-26bc5519546d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07782a6-6e94-4881-8ac7-acd765b2b20f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:01 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:01 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f6829dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1fa189-40b0-486b-adba-f1b7116c8242]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4fe7be-46dd-4dcb-9080-66c7249add3b]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:05:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e451396f-2dae-4621-83be-4f12ea099e86]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f2fd57-06f1-48e3-a0a6-8d83f75a5606]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-a2bd8a61-4d2b-4e22-9abf-80699070b15b req-9f62ee00-ebbd-4385-9663-5fa8740d8dcc service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a2bd8a61-4d2b-4e22-9abf-80699070b15b req-9f62ee00-ebbd-4385-9663-5fa8740d8dcc service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a2bd8a61-4d2b-4e22-9abf-80699070b15b req-9f62ee00-ebbd-4385-9663-5fa8740d8dcc service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a2bd8a61-4d2b-4e22-9abf-80699070b15b req-9f62ee00-ebbd-4385-9663-5fa8740d8dcc service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-a2bd8a61-4d2b-4e22-9abf-80699070b15b req-9f62ee00-ebbd-4385-9663-5fa8740d8dcc service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:02 user nova-compute[74582]: WARNING nova.compute.manager [req-a2bd8a61-4d2b-4e22-9abf-80699070b15b req-9f62ee00-ebbd-4385-9663-5fa8740d8dcc service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state active and task_state shelving.
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132486d-43eb-44c7-9b25-1891603ddc20]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --logout" returned: 0 in 0.230s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a4d05-37a1-4fa2-bb72-ecbd10f3b318]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]
Nov 03 14:05:02 user nova-compute[74582]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524c103-36e1-480d-8285-8e90fc96975a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.553s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] <== disconnect_volume: return (555ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:05:02 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Deleting instance files /opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a_del
Nov 03 14:05:02 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Deletion of /opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a_del complete
Nov 03 14:05:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updated VIF entry in instance network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": null, "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb187fce7-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c11850d3-fc30-4327-8f17-808c6f75fa64 req-336123fa-11d3-46d0-9feb-623d480f8cea service nova] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:03 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Deleted allocations for instance ce4dda5c-bd2b-4bce-9def-e076b5b2106a
Nov 03 14:05:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'numa_topology' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Object Instance<ce4dda5c-bd2b-4bce-9def-e076b5b2106a> lazy-loaded attributes: resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:05:03 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [{"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-76c90aa2-a787-434b-8dfd-d851ecf3cb17" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:04 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:05:04 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:04 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-32fb3019-0de9-4bf5-b098-cbb88c098607 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.727s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:05 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:06 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:05:09 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:05:09 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7672MB free_disk=25.056087493896484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:05:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance c73f6ba0-db7e-484e-980b-93642ef29001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66414a19-4a63-4621-82f2-33d5c60769cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bfd1deec-6150-47c0-b319-02754d07e077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance a967ee46-aa7b-4667-8b6d-54c4c3b0bae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1b594495-ee96-4a48-a789-ab1d14135410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:05:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:11 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:11 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:11 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e87b2-a3ed-4ce7-8965-77c8896f3a31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:05:11 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704f2f1-84ea-4291-8896-a8e2afd9a87d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f] added
Nov 03 14:05:11 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb791601-6230-4d78-a34f-1f67add91840]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eac564-99af-4e6a-ba98-52818582e0be]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgJYiPpK {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgJYiPpK" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[459ba275-880e-43aa-8b91-f71d3aa4c764]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgJYiPpK'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e994bf7-a60d-4462-9470-d643e193c98c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ecc44-ec91-48da-9eef-b2ddd45aa69f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0ce98-04a7-45d4-9868-2dd6003fcab0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]
Nov 03 14:05:12 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba341f08-c477-48d1-9d14-5f980a377f63]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[87767faf-7936-46ff-a353-f00709ad8b40]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:12 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:12 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5b3555-bd3a-4cb1-a539-ea9f1403e5aa]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:05:12 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23333643036326230', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333643036326230', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'flavor' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:05:13 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:05:13 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:05:13 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:05:13 user nova-compute[74582]:   <serial>b56d2602-8e5e-423c-96f5-5891b71c153f</serial>
Nov 03 14:05:13 user nova-compute[74582]: </disk>
Nov 03 14:05:13 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No VIF found with MAC fa:16:3e:2f:e4:54, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "bfd1deec-6150-47c0-b319-02754d07e077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:13 user nova-compute[74582]: INFO nova.compute.manager [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Terminating instance
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3786319d-38dc-43da-a2e3-ea31504e3164 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.863s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-aaa32460-a485-44cf-83ba-864a43eb14e3 req-566aba32-34c0-4483-bf5b-bef69d324d7c service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aaa32460-a485-44cf-83ba-864a43eb14e3 req-566aba32-34c0-4483-bf5b-bef69d324d7c service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aaa32460-a485-44cf-83ba-864a43eb14e3 req-566aba32-34c0-4483-bf5b-bef69d324d7c service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aaa32460-a485-44cf-83ba-864a43eb14e3 req-566aba32-34c0-4483-bf5b-bef69d324d7c service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-aaa32460-a485-44cf-83ba-864a43eb14e3 req-566aba32-34c0-4483-bf5b-bef69d324d7c service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-aaa32460-a485-44cf-83ba-864a43eb14e3 req-566aba32-34c0-4483-bf5b-bef69d324d7c service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-unplugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Instance destroyed successfully.
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.objects.instance [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'resources' on Instance uuid bfd1deec-6150-47c0-b319-02754d07e077 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-359675837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-359675837',id=26,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-fg3n5osw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:28Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=bfd1deec-6150-47c0-b319-02754d07e077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "address": "fa:16:3e:21:04:f9", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba4d9ec-1e", "ovs_interfaceid": "8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_vif [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ba4d9ec-1e, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=570e59ec-6e62-43c6-98b8-7415e1220687) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:14 user nova-compute[74582]: INFO os_vif [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:04:f9,bridge_name='br-int',has_traffic_filtering=True,id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba4d9ec-1e')
Nov 03 14:05:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuJgmTrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[33471015-18df-495d-bd43-be3a3b86998b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:05:14 user nova-compute[74582]: No targets found.
Nov 03 14:05:14 user nova-compute[74582]: iSNS:
Nov 03 14:05:14 user nova-compute[74582]: No targets found.
Nov 03 14:05:14 user nova-compute[74582]: STATIC:
Nov 03 14:05:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2
Nov 03 14:05:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e
Nov 03 14:05:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:05:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:05:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411
Nov 03 14:05:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:05:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:14 user nova-compute[74582]: FIRMWARE:
Nov 03 14:05:14 user nova-compute[74582]: No targets found.
Nov 03 14:05:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:05:14 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:05:14 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44183b-7340-4018-a899-09483f16bd91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a51c5e5-f382-454b-9385-05e4e98d34a7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:15 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683ccca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88de8358-3683-4882-8cc4-a8f2b07abe2f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da2c21e-93bb-4482-9135-aebf398dd89c]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ffff5a-4788-43b8-a31a-d643278e9cf9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.073s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9fa61d-8244-4d28-a921-fb256dbbcfe4]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_37a86668', '/dev/disk/by-id/scsi-23066336661653531', '/dev/disk/by-id/scsi-1SCST_BIO37a86668-0f3fae515d6f1f94') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[38863324-cabf-4203-8157-ebb56ef9625f]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea483699-85e5-490f-adfc-589aa1faf0da]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[07005dac-976e-4f07-975e-045d52ef5a38]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260]
Nov 03 14:05:15 user nova-compute[74582]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f07ed50-ba1f-4e30-b3fd-83130e932411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4333b6f-502f-4ae7-9390-fececea2d6f3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== disconnect_volume: return (441ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:05:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Deleting instance files /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077_del
Nov 03 14:05:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Deletion of /opt/stack/data/nova/instances/bfd1deec-6150-47c0-b319-02754d07e077_del complete
Nov 03 14:05:15 user nova-compute[74582]: INFO nova.compute.manager [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 03 14:05:15 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:05:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-e421159f-b6fb-4061-b1f6-05d0f818d32a req-1c9826c9-97d9-4673-a513-d17b50cf3c57 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e421159f-b6fb-4061-b1f6-05d0f818d32a req-1c9826c9-97d9-4673-a513-d17b50cf3c57 service nova] Acquiring lock "bfd1deec-6150-47c0-b319-02754d07e077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e421159f-b6fb-4061-b1f6-05d0f818d32a req-1c9826c9-97d9-4673-a513-d17b50cf3c57 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e421159f-b6fb-4061-b1f6-05d0f818d32a req-1c9826c9-97d9-4673-a513-d17b50cf3c57 service nova] Lock "bfd1deec-6150-47c0-b319-02754d07e077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-e421159f-b6fb-4061-b1f6-05d0f818d32a req-1c9826c9-97d9-4673-a513-d17b50cf3c57 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] No waiting events found dispatching network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:16 user nova-compute[74582]: WARNING nova.compute.manager [req-e421159f-b6fb-4061-b1f6-05d0f818d32a req-1c9826c9-97d9-4673-a513-d17b50cf3c57 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received unexpected event network-vif-plugged-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 for instance with vm_state active and task_state deleting.
Nov 03 14:05:16 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-d638793c-d412-482d-8d94-3f7769a6bc47 req-60ff0151-b777-4014-ad8f-e5e808591ba4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Received event network-vif-deleted-8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:16 user nova-compute[74582]: INFO nova.compute.manager [req-d638793c-d412-482d-8d94-3f7769a6bc47 req-60ff0151-b777-4014-ad8f-e5e808591ba4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Neutron deleted interface 8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93; detaching it from the instance and deleting it from the info cache
Nov 03 14:05:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-d638793c-d412-482d-8d94-3f7769a6bc47 req-60ff0151-b777-4014-ad8f-e5e808591ba4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:16 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Took 1.17 seconds to deallocate network for instance.
Nov 03 14:05:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-d638793c-d412-482d-8d94-3f7769a6bc47 req-60ff0151-b777-4014-ad8f-e5e808591ba4 service nova] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Detach interface failed, port_id=8ba4d9ec-1e22-4ff5-b2e5-8bab0298ce93, reason: Instance bfd1deec-6150-47c0-b319-02754d07e077 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:05:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:19 user nova-compute[74582]: INFO nova.compute.manager [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Terminating instance
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-changed-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing instance network info cache due to event network-changed-63344b70-dfc1-4bef-bead-ed43f9644d32. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] Acquiring lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] Acquired lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.network.neutron [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Refreshing network info cache for port 63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Instance destroyed successfully.
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lazy-loading 'resources' on Instance uuid a967ee46-aa7b-4667-8b6d-54c4c3b0bae1 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-124149186',display_name='tempest-VolumesActionsTest-instance-124149186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-124149186',id=30,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:02:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24834f917a16463fb400b4028ff97a0e',ramdisk_id='',reservation_id='r-eltyhj5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1234039932',owner_user_name='tempest-VolumesActionsTest-1234039932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:02:59Z,user_data=None,user_id='3230b5c41139457a8e652d5c8f60ea7f',uuid=a967ee46-aa7b-4667-8b6d-54c4c3b0bae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Converting VIF {"id": "c2608fcc-defb-47ab-997a-97382a6d7b52", "address": "fa:16:3e:cf:88:07", "network": {"id": "d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736142462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24834f917a16463fb400b4028ff97a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2608fcc-de", "ovs_interfaceid": "c2608fcc-defb-47ab-997a-97382a6d7b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG os_vif [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2608fcc-de, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bf102e7-f057-4d94-a933-7f947e8ebe07) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:20 user nova-compute[74582]: INFO os_vif [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:88:07,bridge_name='br-int',has_traffic_filtering=True,id=c2608fcc-defb-47ab-997a-97382a6d7b52,network=Network(d0192c30-fc3d-4aaf-adb9-0c26a4ae41f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2608fcc-de')
Nov 03 14:05:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Deleting instance files /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1_del
Nov 03 14:05:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Deletion of /opt/stack/data/nova/instances/a967ee46-aa7b-4667-8b6d-54c4c3b0bae1_del complete
Nov 03 14:05:20 user nova-compute[74582]: INFO nova.compute.manager [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 03 14:05:20 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:05:20 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-721e2bfe-7689-409b-870d-b521975cd522 req-b1136ddd-765f-4fde-bcfe-310e8863844f service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-vif-unplugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-721e2bfe-7689-409b-870d-b521975cd522 req-b1136ddd-765f-4fde-bcfe-310e8863844f service nova] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-721e2bfe-7689-409b-870d-b521975cd522 req-b1136ddd-765f-4fde-bcfe-310e8863844f service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-721e2bfe-7689-409b-870d-b521975cd522 req-b1136ddd-765f-4fde-bcfe-310e8863844f service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-721e2bfe-7689-409b-870d-b521975cd522 req-b1136ddd-765f-4fde-bcfe-310e8863844f service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] No waiting events found dispatching network-vif-unplugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-721e2bfe-7689-409b-870d-b521975cd522 req-b1136ddd-765f-4fde-bcfe-310e8863844f service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-vif-unplugged-c2608fcc-defb-47ab-997a-97382a6d7b52 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:21 user nova-compute[74582]: INFO nova.compute.manager [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Terminating instance
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:21 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Took 0.86 seconds to deallocate network for instance.
Nov 03 14:05:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updated VIF entry in instance network info cache for port 63344b70-dfc1-4bef-bead-ed43f9644d32. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e62a43c0-0c3c-4bc0-8805-339b4a9c65cb req-a0f63dbe-3e96-458a-81a5-f6653402b5d9 service nova] Releasing lock "refresh_cache-345a0ccc-0e2a-45a9-8cc3-a30865db79d0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-e7565a95-f2de-4bf0-9032-05d6d4d990e6 req-e5b2befc-b755-44d6-9b61-9a9b522659d8 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-vif-unplugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e7565a95-f2de-4bf0-9032-05d6d4d990e6 req-e5b2befc-b755-44d6-9b61-9a9b522659d8 service nova] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e7565a95-f2de-4bf0-9032-05d6d4d990e6 req-e5b2befc-b755-44d6-9b61-9a9b522659d8 service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e7565a95-f2de-4bf0-9032-05d6d4d990e6 req-e5b2befc-b755-44d6-9b61-9a9b522659d8 service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-e7565a95-f2de-4bf0-9032-05d6d4d990e6 req-e5b2befc-b755-44d6-9b61-9a9b522659d8 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] No waiting events found dispatching network-vif-unplugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-e7565a95-f2de-4bf0-9032-05d6d4d990e6 req-e5b2befc-b755-44d6-9b61-9a9b522659d8 service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-vif-unplugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:22 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Deleted allocations for instance a967ee46-aa7b-4667-8b6d-54c4c3b0bae1
Nov 03 14:05:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Instance destroyed successfully.
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lazy-loading 'resources' on Instance uuid c73f6ba0-db7e-484e-980b-93642ef29001 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-75bf659c-07bb-498b-af9d-af802244439b tempest-VolumesActionsTest-1234039932 tempest-VolumesActionsTest-1234039932-project-member] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.550s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-925816892',display_name='tempest-SnapshotDataIntegrityTests-server-925816892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-925816892',id=16,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1ut87jn4Pfhsc7A0fp6qP5N9bf9EaPnYBXA+8CwSiyeLZWLOudLKTOT/s5IhWHwg1OomlY1T4HosDdqo0sNtsJiSHoigtivFqLJgQ5cie3awZorZwpSBpzYPhRv10qDQ==',key_name='tempest-keypair-1143797370',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:54:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89efd26950cb4876aca4dab449f19ecb',ramdisk_id='',reservation_id='r-mpc0lvvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1375647291',owner_user_name='tempest-SnapshotDataIntegrityTests-1375647291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec6f24a8eb554a7593b8771a4616a259',uuid=c73f6ba0-db7e-484e-980b-93642ef29001,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Converting VIF {"id": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "address": "fa:16:3e:40:c0:b6", "network": {"id": "87140b19-63e0-47e1-a1b0-f79d4b977cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-873708357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89efd26950cb4876aca4dab449f19ecb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ebd409-89", "ovs_interfaceid": "13ebd409-8962-428d-9ae8-57dd2613ffc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG os_vif [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13ebd409-89, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58195c45-e7b6-4d4d-b02e-b6593b3ac58c) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:22 user nova-compute[74582]: INFO os_vif [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c0:b6,bridge_name='br-int',has_traffic_filtering=True,id=13ebd409-8962-428d-9ae8-57dd2613ffc5,network=Network(87140b19-63e0-47e1-a1b0-f79d4b977cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ebd409-89')
Nov 03 14:05:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Deleting instance files /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001_del
Nov 03 14:05:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Deletion of /opt/stack/data/nova/instances/c73f6ba0-db7e-484e-980b-93642ef29001_del complete
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-cd55ebad-dab9-4b5e-b435-d593cde929fb req-e1a9962c-e494-4727-a816-747822fed765 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-vif-deleted-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:22 user nova-compute[74582]: INFO nova.compute.manager [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 03 14:05:22 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:05:22 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-a15c7a49-6eba-4cb0-b327-0c73d2968641 req-e0398c88-f4d7-4b66-a65f-d9278d6a56f3 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received event network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a15c7a49-6eba-4cb0-b327-0c73d2968641 req-e0398c88-f4d7-4b66-a65f-d9278d6a56f3 service nova] Acquiring lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a15c7a49-6eba-4cb0-b327-0c73d2968641 req-e0398c88-f4d7-4b66-a65f-d9278d6a56f3 service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a15c7a49-6eba-4cb0-b327-0c73d2968641 req-e0398c88-f4d7-4b66-a65f-d9278d6a56f3 service nova] Lock "a967ee46-aa7b-4667-8b6d-54c4c3b0bae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-a15c7a49-6eba-4cb0-b327-0c73d2968641 req-e0398c88-f4d7-4b66-a65f-d9278d6a56f3 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] No waiting events found dispatching network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:23 user nova-compute[74582]: WARNING nova.compute.manager [req-a15c7a49-6eba-4cb0-b327-0c73d2968641 req-e0398c88-f4d7-4b66-a65f-d9278d6a56f3 service nova] [instance: a967ee46-aa7b-4667-8b6d-54c4c3b0bae1] Received unexpected event network-vif-plugged-c2608fcc-defb-47ab-997a-97382a6d7b52 for instance with vm_state deleted and task_state None.
Nov 03 14:05:23 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:23 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Took 1.05 seconds to deallocate network for instance.
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:23 user nova-compute[74582]: INFO nova.compute.manager [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Terminating instance
Nov 03 14:05:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Deleted allocations for instance c73f6ba0-db7e-484e-980b-93642ef29001
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-34dae133-0a6e-4c25-b7d2-bdf5feb3419d tempest-SnapshotDataIntegrityTests-1375647291 tempest-SnapshotDataIntegrityTests-1375647291-project-member] Lock "c73f6ba0-db7e-484e-980b-93642ef29001" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-ffc10462-f5a1-471c-9938-5723ccb7d24f req-11abaa34-ce2e-43f6-b4a5-df6d32dadcdf service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ffc10462-f5a1-471c-9938-5723ccb7d24f req-11abaa34-ce2e-43f6-b4a5-df6d32dadcdf service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ffc10462-f5a1-471c-9938-5723ccb7d24f req-11abaa34-ce2e-43f6-b4a5-df6d32dadcdf service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ffc10462-f5a1-471c-9938-5723ccb7d24f req-11abaa34-ce2e-43f6-b4a5-df6d32dadcdf service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-ffc10462-f5a1-471c-9938-5723ccb7d24f req-11abaa34-ce2e-43f6-b4a5-df6d32dadcdf service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-ffc10462-f5a1-471c-9938-5723ccb7d24f req-11abaa34-ce2e-43f6-b4a5-df6d32dadcdf service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-6a027b3c-1b58-4d5d-b013-458053df7acd for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-5e6fc59d-6b75-4c1c-8f53-2aa8327c760b req-2710b9ba-2fac-40d0-a81e-c4442caf713a service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5e6fc59d-6b75-4c1c-8f53-2aa8327c760b req-2710b9ba-2fac-40d0-a81e-c4442caf713a service nova] Acquiring lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5e6fc59d-6b75-4c1c-8f53-2aa8327c760b req-2710b9ba-2fac-40d0-a81e-c4442caf713a service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5e6fc59d-6b75-4c1c-8f53-2aa8327c760b req-2710b9ba-2fac-40d0-a81e-c4442caf713a service nova] Lock "c73f6ba0-db7e-484e-980b-93642ef29001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-5e6fc59d-6b75-4c1c-8f53-2aa8327c760b req-2710b9ba-2fac-40d0-a81e-c4442caf713a service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] No waiting events found dispatching network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:24 user nova-compute[74582]: WARNING nova.compute.manager [req-5e6fc59d-6b75-4c1c-8f53-2aa8327c760b req-2710b9ba-2fac-40d0-a81e-c4442caf713a service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received unexpected event network-vif-plugged-13ebd409-8962-428d-9ae8-57dd2613ffc5 for instance with vm_state deleted and task_state None.
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Instance destroyed successfully.
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lazy-loading 'resources' on Instance uuid 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: c73f6ba0-db7e-484e-980b-93642ef29001] Received event network-vif-deleted-13ebd409-8962-428d-9ae8-57dd2613ffc5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-634c9379-cbad-4756-9413-c0bf8b578acd for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:25 user nova-compute[74582]: WARNING nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-634c9379-cbad-4756-9413-c0bf8b578acd for instance with vm_state active and task_state deleting.
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-353838c4-eafd-43ad-8e13-ab48ec57af12 req-d1f8f4ed-e57f-4245-b704-ef34e68b1bda service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63344b70-df, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d3a83e8-39fc-4bd8-a77a-29fa6e3f4c5c) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7b:72,bridge_name='br-int',has_traffic_filtering=True,id=63344b70-dfc1-4bef-bead-ed43f9644d32,network=Network(eb5ae943-50b8-4cb8-b73f-a10693d925d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63344b70-df')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a027b3c-1b, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a20868a4-cb03-41cb-ac07-7ce5f2e364fe) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:15:04,bridge_name='br-int',has_traffic_filtering=True,id=6a027b3c-1b58-4d5d-b013-458053df7acd,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a027b3c-1b')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa047da4c-eb, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ab6eb98-be08-43c1-854f-a048da20ffbb) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=a047da4c-eb2d-487d-87b9-e9c33222ec92,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa047da4c-eb')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "address": "fa:16:3e:cc:d4:a6", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b06a2c-20", "ovs_interfaceid": "37b06a2c-20d9-48ff-995f-0404c8cfcb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37b06a2c-20, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c677308f-ed9c-4076-86b8-927c14fbbb9c) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d4:a6,bridge_name='br-int',has_traffic_filtering=True,id=37b06a2c-20d9-48ff-995f-0404c8cfcb21,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b06a2c-20')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc249a4b1-0d, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=448d3d59-bf78-47e6-b70c-756f0ff4f9ad) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cb:46,bridge_name='br-int',has_traffic_filtering=True,id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4,network=Network(468141fd-2b42-4353-a620-b710814703cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc249a4b1-0d')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap634c9379-cb, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7201ae-57fe-4d36-9e21-2c885df60abf) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=634c9379-cbad-4756-9413-c0bf8b578acd,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap634c9379-cb')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T14:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180745369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180745369',id=28,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ti5XqrCMhoMohB3a2JTvkUuuafgL9ctOgqOu9NZ6nz4bFjRWLes7a4CWvnm/IsgyU5wC3IGGI+wbq9w5I+YCFApEqFAKBX+pMchIBkSzcv098cYCC1R3mNR5yTYBizA==',key_name='tempest-keypair-1881188083',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938cabd29d654edc94cac90c27adf1fb',ramdisk_id='',reservation_id='r-ep08l7tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-384199897',owner_user_name='tempest-TaggedBootDevicesTest-384199897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ff58b22a904574bfb6e4f92af5226d',uuid=345a0ccc-0e2a-45a9-8cc3-a30865db79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converting VIF {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8000a0-4e, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=953a01ed-a872-4cda-8577-ac5df54e6aa2) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:26 user nova-compute[74582]: INFO os_vif [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:2e,bridge_name='br-int',has_traffic_filtering=True,id=8c8000a0-4ebd-40a8-ba7f-6149580aabb9,network=Network(951dd95b-5a11-4e46-ac25-d1845a0056a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8000a0-4e')
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwaClEBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:26 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d7e40e-243b-4270-b4db-5ddaa5f83208]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:05:26 user nova-compute[74582]: No targets found.
Nov 03 14:05:26 user nova-compute[74582]: iSNS:
Nov 03 14:05:26 user nova-compute[74582]: No targets found.
Nov 03 14:05:26 user nova-compute[74582]: STATIC:
Nov 03 14:05:26 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2
Nov 03 14:05:26 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:26 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:26 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e
Nov 03 14:05:26 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:26 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:26 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:05:26 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:26 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:26 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:05:26 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:26 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:26 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:05:26 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:26 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:26 user nova-compute[74582]: FIRMWARE:
Nov 03 14:05:26 user nova-compute[74582]: No targets found.
Nov 03 14:05:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:05:26 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:05:26 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503abd6-d971-4357-805b-47110933d66d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd3f2c-bc0f-46c9-96e6-79322e928613]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e (non-flash)
Nov 03 14:05:26 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:26 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683e2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e'): ({'sdi'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Removing single pathed devices sdi {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ecfe3-c588-4a56-aca2-6c0895c3ddc8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9fbabd-2ca6-4057-85a7-831b977f3953]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Flushing IO for device /dev/sdi {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[829f05b1-4ba4-4891-89a5-1eb9de95c429]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-edb15a7d-bb4b-4720-b19e-41557890bc71 req-4af389e7-259b-4445-a021-deaac21d8940 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-edb15a7d-bb4b-4720-b19e-41557890bc71 req-4af389e7-259b-4445-a021-deaac21d8940 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-edb15a7d-bb4b-4720-b19e-41557890bc71 req-4af389e7-259b-4445-a021-deaac21d8940 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-edb15a7d-bb4b-4720-b19e-41557890bc71 req-4af389e7-259b-4445-a021-deaac21d8940 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-edb15a7d-bb4b-4720-b19e-41557890bc71 req-4af389e7-259b-4445-a021-deaac21d8940 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: WARNING nova.compute.manager [req-edb15a7d-bb4b-4720-b19e-41557890bc71 req-4af389e7-259b-4445-a021-deaac21d8940 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-6a027b3c-1b58-4d5d-b013-458053df7acd for instance with vm_state active and task_state deleting.
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-63344b70-dfc1-4bef-bead-ed43f9644d32 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: WARNING nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-63344b70-dfc1-4bef-bead-ed43f9644d32 for instance with vm_state active and task_state deleting.
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: WARNING nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-a047da4c-eb2d-487d-87b9-e9c33222ec92 for instance with vm_state active and task_state deleting.
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:26 user nova-compute[74582]: WARNING nova.compute.manager [req-3bcc9281-d62b-444e-8109-465b04463054 req-8a7d4a7e-5d1b-427c-9b36-e16f4acbf5dc service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-37b06a2c-20d9-48ff-995f-0404c8cfcb21 for instance with vm_state active and task_state deleting.
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.066s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a02964-bc14-4f44-88dc-6bfe53ab925c]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] SCSI volumes sdi have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[71daf587-4598-47fb-b97b-25f10df65a6c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00e0543-74e2-4969-a5e8-d4ef16f4f2f4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260]
Nov 03 14:05:27 user nova-compute[74582]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfd91ca-90c8-41f1-aee7-04884279fe9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3718677-8137-4670-a224-f27baff7b067]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== disconnect_volume: return (437ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIMSxhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eb1a00-bc40-447f-a175-3b7894291b3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:05:27 user nova-compute[74582]: No targets found.
Nov 03 14:05:27 user nova-compute[74582]: iSNS:
Nov 03 14:05:27 user nova-compute[74582]: No targets found.
Nov 03 14:05:27 user nova-compute[74582]: STATIC:
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: FIRMWARE:
Nov 03 14:05:27 user nova-compute[74582]: No targets found.
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:05:27 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:05:27 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[41392373-571c-4c48-8d3e-36bb0b485707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573cdfd-592d-4efb-9cc7-534d9da35009]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f803bbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2'): ({'sdh'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Removing single pathed devices sdh {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb473e88-23ac-4858-85f7-b04fdc2b7d56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b5755-e357-4121-a342-1d07f5650480]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Flushing IO for device /dev/sdh {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8929f-73c0-45b8-880c-5809e4da6d92]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[360c07af-fb85-4489-9a73-6fe031c05218]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] SCSI volumes sdh have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6dc9e-8532-4876-b57c-4be83f867d59]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76426124-3284-439a-aa43-dd0634ddcc1b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260]
Nov 03 14:05:27 user nova-compute[74582]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf17db-364c-44e4-be49-5d4464d30fe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd03e1e-1d91-4b03-bbd8-920c5344385a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== disconnect_volume: return (342ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxtrMZdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283dc3e-6e5d-4c46-988c-03a86128835a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:05:27 user nova-compute[74582]: No targets found.
Nov 03 14:05:27 user nova-compute[74582]: iSNS:
Nov 03 14:05:27 user nova-compute[74582]: No targets found.
Nov 03 14:05:27 user nova-compute[74582]: STATIC:
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:05:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:27 user nova-compute[74582]: FIRMWARE:
Nov 03 14:05:27 user nova-compute[74582]: No targets found.
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:05:27 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:05:27 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cadd7d-39c3-4061-a0ea-dc4da116c4a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c394e-c567-42bd-82bb-d08622f86f11]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a (non-flash)
Nov 03 14:05:27 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f803bbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a'): ({'sde'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Removing single pathed devices sde {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[16652a20-e7fa-49d2-9bcc-5d3808c458b3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b824aaaf-2b28-4b1f-87c0-55e723773658]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Flushing IO for device /dev/sde {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb9c90-03a8-4e26-84da-f95c09508d1a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd5d32a-8a83-4c2d-a6c2-6ffcc8e3492c]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] SCSI volumes sde have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c9e8e2-ba0d-4efc-984c-7e14d7d465c6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb2b299-02e5-4ece-8c93-802a200c7cb6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260]
Nov 03 14:05:27 user nova-compute[74582]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da79b803-1ea8-486a-bfa7-b5f67af6797a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d621680e-cd41-420a-9a0c-9f3e196e0b09]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] <== disconnect_volume: return (350ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:05:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Deleting instance files /opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0_del
Nov 03 14:05:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Deletion of /opt/stack/data/nova/instances/345a0ccc-0e2a-45a9-8cc3-a30865db79d0_del complete
Nov 03 14:05:27 user nova-compute[74582]: INFO nova.compute.manager [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Took 3.89 seconds to destroy the instance on the hypervisor.
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-9e69e1f0-a20c-4766-bd4d-86393e6e4aa8 req-5f34237c-6b6d-4251-8903-3655af3d243c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9e69e1f0-a20c-4766-bd4d-86393e6e4aa8 req-5f34237c-6b6d-4251-8903-3655af3d243c service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9e69e1f0-a20c-4766-bd4d-86393e6e4aa8 req-5f34237c-6b6d-4251-8903-3655af3d243c service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9e69e1f0-a20c-4766-bd4d-86393e6e4aa8 req-5f34237c-6b6d-4251-8903-3655af3d243c service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-9e69e1f0-a20c-4766-bd4d-86393e6e4aa8 req-5f34237c-6b6d-4251-8903-3655af3d243c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:27 user nova-compute[74582]: WARNING nova.compute.manager [req-9e69e1f0-a20c-4766-bd4d-86393e6e4aa8 req-5f34237c-6b6d-4251-8903-3655af3d243c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 for instance with vm_state active and task_state deleting.
Nov 03 14:05:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-unplugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-unplugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] Acquiring lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] No waiting events found dispatching network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:29 user nova-compute[74582]: WARNING nova.compute.manager [req-1e117100-afbe-4088-90e6-b8292e59c3cd req-cdafd754-632e-4c5e-a9d0-42c73481a214 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received unexpected event network-vif-plugged-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 for instance with vm_state active and task_state deleting.
Nov 03 14:05:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-7dfc19f3-ee3e-49b4-acd7-db8ae884b0ad req-9070c74b-5686-44f5-8a8b-76cb3aa73d3c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-deleted-37b06a2c-20d9-48ff-995f-0404c8cfcb21 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:30 user nova-compute[74582]: INFO nova.compute.manager [req-7dfc19f3-ee3e-49b4-acd7-db8ae884b0ad req-9070c74b-5686-44f5-8a8b-76cb3aa73d3c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Neutron deleted interface 37b06a2c-20d9-48ff-995f-0404c8cfcb21; detaching it from the instance and deleting it from the info cache
Nov 03 14:05:30 user nova-compute[74582]: DEBUG nova.network.neutron [req-7dfc19f3-ee3e-49b4-acd7-db8ae884b0ad req-9070c74b-5686-44f5-8a8b-76cb3aa73d3c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "address": "fa:16:3e:e5:cb:46", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc249a4b1-0d", "ovs_interfaceid": "c249a4b1-0d9c-4103-9177-de45f2c2d0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-7dfc19f3-ee3e-49b4-acd7-db8ae884b0ad req-9070c74b-5686-44f5-8a8b-76cb3aa73d3c service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Detach interface failed, port_id=37b06a2c-20d9-48ff-995f-0404c8cfcb21, reason: Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing instance network info cache due to event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG nova.network.neutron [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG nova.network.neutron [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updated VIF entry in instance network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG nova.network.neutron [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d0053bf9-f3f7-4e65-b53f-6afe59eede9b req-372f4945-2a65-46cd-bc2a-71babae49789 service nova] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:32 user nova-compute[74582]: DEBUG nova.compute.manager [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-deleted-c249a4b1-0d9c-4103-9177-de45f2c2d0c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:32 user nova-compute[74582]: INFO nova.compute.manager [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Neutron deleted interface c249a4b1-0d9c-4103-9177-de45f2c2d0c4; detaching it from the instance and deleting it from the info cache
Nov 03 14:05:32 user nova-compute[74582]: DEBUG nova.network.neutron [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [{"id": "63344b70-dfc1-4bef-bead-ed43f9644d32", "address": "fa:16:3e:c3:7b:72", "network": {"id": "eb5ae943-50b8-4cb8-b73f-a10693d925d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1121112187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63344b70-df", "ovs_interfaceid": "63344b70-dfc1-4bef-bead-ed43f9644d32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Detach interface failed, port_id=c249a4b1-0d9c-4103-9177-de45f2c2d0c4, reason: Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:05:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-deleted-63344b70-dfc1-4bef-bead-ed43f9644d32 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:33 user nova-compute[74582]: INFO nova.compute.manager [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Neutron deleted interface 63344b70-dfc1-4bef-bead-ed43f9644d32; detaching it from the instance and deleting it from the info cache
Nov 03 14:05:33 user nova-compute[74582]: DEBUG nova.network.neutron [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [{"id": "6a027b3c-1b58-4d5d-b013-458053df7acd", "address": "fa:16:3e:58:15:04", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a027b3c-1b", "ovs_interfaceid": "6a027b3c-1b58-4d5d-b013-458053df7acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "address": "fa:16:3e:f3:0b:28", "network": {"id": "468141fd-2b42-4353-a620-b710814703cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-916201344", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa047da4c-eb", "ovs_interfaceid": "a047da4c-eb2d-487d-87b9-e9c33222ec92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "634c9379-cbad-4756-9413-c0bf8b578acd", "address": "fa:16:3e:53:4b:c0", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap634c9379-cb", "ovs_interfaceid": "634c9379-cbad-4756-9413-c0bf8b578acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "address": "fa:16:3e:b9:84:2e", "network": {"id": "951dd95b-5a11-4e46-ac25-d1845a0056a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1882606976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "938cabd29d654edc94cac90c27adf1fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8000a0-4e", "ovs_interfaceid": "8c8000a0-4ebd-40a8-ba7f-6149580aabb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-9018bd61-2f75-4f96-8227-72c225f19e74 req-44a0059a-fee9-4670-97ff-eef3d5fedc63 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Detach interface failed, port_id=63344b70-dfc1-4bef-bead-ed43f9644d32, reason: Instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:34 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Took 6.51 seconds to deallocate network for instance.
Nov 03 14:05:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:05:34 user nova-compute[74582]: INFO nova.compute.claims [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Claim successful on node user
Nov 03 14:05:34 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:34 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-deleted-8c8000a0-4ebd-40a8-ba7f-6149580aabb9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Received event network-vif-deleted-634c9379-cbad-4756-9413-c0bf8b578acd {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing instance network info cache due to event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.network.neutron [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:05:35 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:05:35 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Creating image(s)
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "/opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "/opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.policy [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db5774b6cb564ba98174b4cf04888359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a5c94d1094e269259d0b6037319aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.network.neutron [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updated VIF entry in instance network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG nova.network.neutron [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-108b745d-6884-4a0a-a558-bf7d5717f33b req-16767288-7ca4-4381-a041-7de808a8fa05 service nova] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.227s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk 1073741824" returned: 0 in 0.051s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.243s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Successfully created port: 4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Cannot resize image /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Ensure instance console log exists: /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Successfully updated port: 4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquired lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-changed-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Refreshing instance network info cache due to event network-changed-4a0d26f3-2c5f-4e94-945c-89ef74798cba. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] Acquiring lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:05:37 user nova-compute[74582]: INFO nova.compute.manager [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: bfd1deec-6150-47c0-b319-02754d07e077] Took 20.83 seconds to detach 1 volumes for instance.
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating instance_info_cache with network_info: [{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Releasing lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Instance network_info: |[{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] Acquired lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.neutron [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Refreshing network info cache for port 4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Start _get_guest_xml network_info=[{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:05:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-86748892',display_name='tempest-TestStampPattern-server-86748892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-86748892',id=32,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtb8RAC35Ay0NuOoY0sqUucIv1xSQ5rEt2guSpAdeXJNP1NDaO8I8qlX3itFFRV8dIepDCZk1yyH9FZ6lG5GcbOOfXTSmewWSLa+X/BsbXndkr4Ujjx09AOtfXavppNwg==',key_name='tempest-TestStampPattern-1127467608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a5c94d1094e269259d0b6037319aa',ramdisk_id='',reservation_id='r-vza2d6fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-722996733',owner_user_name='tempest-TestStampPattern-722996733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:05:35Z,user_data=None,user_id='db5774b6cb564ba98174b4cf04888359',uuid=8f30eb65-1553-4f18-a861-b97e58dda769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converting VIF {"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f30eb65-1553-4f18-a861-b97e58dda769 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:05:37 user nova-compute[74582]:   <uuid>8f30eb65-1553-4f18-a861-b97e58dda769</uuid>
Nov 03 14:05:37 user nova-compute[74582]:   <name>instance-00000020</name>
Nov 03 14:05:37 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:05:37 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:05:37 user nova-compute[74582]:   <metadata>
Nov 03 14:05:37 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:05:37 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:05:37 user nova-compute[74582]:       <nova:name>tempest-TestStampPattern-server-86748892</nova:name>
Nov 03 14:05:37 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:05:37</nova:creationTime>
Nov 03 14:05:37 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:05:37 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:05:37 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:05:37 user nova-compute[74582]:       <nova:owner>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:user uuid="db5774b6cb564ba98174b4cf04888359">tempest-TestStampPattern-722996733-project-member</nova:user>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:project uuid="d77a5c94d1094e269259d0b6037319aa">tempest-TestStampPattern-722996733</nova:project>
Nov 03 14:05:37 user nova-compute[74582]:       </nova:owner>
Nov 03 14:05:37 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:05:37 user nova-compute[74582]:       <nova:ports>
Nov 03 14:05:37 user nova-compute[74582]:         <nova:port uuid="4a0d26f3-2c5f-4e94-945c-89ef74798cba">
Nov 03 14:05:37 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 14:05:37 user nova-compute[74582]:         </nova:port>
Nov 03 14:05:37 user nova-compute[74582]:       </nova:ports>
Nov 03 14:05:37 user nova-compute[74582]:     </nova:instance>
Nov 03 14:05:37 user nova-compute[74582]:   </metadata>
Nov 03 14:05:37 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:05:37 user nova-compute[74582]:     <system>
Nov 03 14:05:37 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:05:37 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:05:37 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:05:37 user nova-compute[74582]:       <entry name="serial">8f30eb65-1553-4f18-a861-b97e58dda769</entry>
Nov 03 14:05:37 user nova-compute[74582]:       <entry name="uuid">8f30eb65-1553-4f18-a861-b97e58dda769</entry>
Nov 03 14:05:37 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:05:37 user nova-compute[74582]:     </system>
Nov 03 14:05:37 user nova-compute[74582]:   </sysinfo>
Nov 03 14:05:37 user nova-compute[74582]:   <os>
Nov 03 14:05:37 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:05:37 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:05:37 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:05:37 user nova-compute[74582]:   </os>
Nov 03 14:05:37 user nova-compute[74582]:   <features>
Nov 03 14:05:37 user nova-compute[74582]:     <acpi/>
Nov 03 14:05:37 user nova-compute[74582]:     <apic/>
Nov 03 14:05:37 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:05:37 user nova-compute[74582]:   </features>
Nov 03 14:05:37 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:05:37 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:05:37 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:05:37 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:05:37 user nova-compute[74582]:   </clock>
Nov 03 14:05:37 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:05:37 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:05:37 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:05:37 user nova-compute[74582]:   </cpu>
Nov 03 14:05:37 user nova-compute[74582]:   <devices>
Nov 03 14:05:37 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:05:37 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:05:37 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk"/>
Nov 03 14:05:37 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:05:37 user nova-compute[74582]:     </disk>
Nov 03 14:05:37 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:05:37 user nova-compute[74582]:       <mac address="fa:16:3e:f6:33:2b"/>
Nov 03 14:05:37 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:05:37 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:05:37 user nova-compute[74582]:       <target dev="tap4a0d26f3-2c"/>
Nov 03 14:05:37 user nova-compute[74582]:     </interface>
Nov 03 14:05:37 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:05:37 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/console.log" append="off"/>
Nov 03 14:05:37 user nova-compute[74582]:     </serial>
Nov 03 14:05:37 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:05:37 user nova-compute[74582]:     <video>
Nov 03 14:05:37 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:05:37 user nova-compute[74582]:     </video>
Nov 03 14:05:37 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:05:37 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:05:37 user nova-compute[74582]:     </rng>
Nov 03 14:05:37 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:05:37 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:05:37 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:05:37 user nova-compute[74582]:     </memballoon>
Nov 03 14:05:37 user nova-compute[74582]:   </devices>
Nov 03 14:05:37 user nova-compute[74582]: </domain>
Nov 03 14:05:37 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-86748892',display_name='tempest-TestStampPattern-server-86748892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-86748892',id=32,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtb8RAC35Ay0NuOoY0sqUucIv1xSQ5rEt2guSpAdeXJNP1NDaO8I8qlX3itFFRV8dIepDCZk1yyH9FZ6lG5GcbOOfXTSmewWSLa+X/BsbXndkr4Ujjx09AOtfXavppNwg==',key_name='tempest-TestStampPattern-1127467608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a5c94d1094e269259d0b6037319aa',ramdisk_id='',reservation_id='r-vza2d6fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-722996733',owner_user_name='tempest-TestStampPattern-722996733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:05:35Z,user_data=None,user_id='db5774b6cb564ba98174b4cf04888359',uuid=8f30eb65-1553-4f18-a861-b97e58dda769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converting VIF {"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG os_vif [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d8c88c4-b672-5aba-949b-3f637e231810', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a0d26f3-2c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a0d26f3-2c, col_values=(('qos', UUID('871ca5bb-083b-4ed3-8adf-20b2f3619016')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a0d26f3-2c, col_values=(('external_ids', {'iface-id': '4a0d26f3-2c5f-4e94-945c-89ef74798cba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:33:2b', 'vm-uuid': '8f30eb65-1553-4f18-a861-b97e58dda769'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:37 user nova-compute[74582]: INFO os_vif [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c')
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No VIF found with MAC fa:16:3e:f6:33:2b, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:05:37 user nova-compute[74582]: INFO nova.compute.manager [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] [instance: 345a0ccc-0e2a-45a9-8cc3-a30865db79d0] Took 3.50 seconds to detach 3 volumes for instance.
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:38 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Deleted allocations for instance bfd1deec-6150-47c0-b319-02754d07e077
Nov 03 14:05:38 user nova-compute[74582]: DEBUG nova.network.neutron [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updated VIF entry in instance network info cache for port 4a0d26f3-2c5f-4e94-945c-89ef74798cba. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:05:38 user nova-compute[74582]: DEBUG nova.network.neutron [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating instance_info_cache with network_info: [{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0e7eeb4-4c8a-4852-a31d-59b4661c69f8 req-f532eda7-c4f4-42ed-bc91-230b86ea5243 service nova] Releasing lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1f513a21-bb55-4686-af74-3013271d8aab tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "bfd1deec-6150-47c0-b319-02754d07e077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.259s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:38 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:05:38 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:05:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:38 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Deleted allocations for instance 345a0ccc-0e2a-45a9-8cc3-a30865db79d0
Nov 03 14:05:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1883f02b-9b1e-4f34-a31f-161d0736a493 tempest-TaggedBootDevicesTest-384199897 tempest-TaggedBootDevicesTest-384199897-project-member] Lock "345a0ccc-0e2a-45a9-8cc3-a30865db79d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.531s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-1c2dc005-876f-43ed-8625-b6f66b434eb1 req-bdc13a87-a405-4ca0-a39f-9349c2477923 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1c2dc005-876f-43ed-8625-b6f66b434eb1 req-bdc13a87-a405-4ca0-a39f-9349c2477923 service nova] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1c2dc005-876f-43ed-8625-b6f66b434eb1 req-bdc13a87-a405-4ca0-a39f-9349c2477923 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1c2dc005-876f-43ed-8625-b6f66b434eb1 req-bdc13a87-a405-4ca0-a39f-9349c2477923 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-1c2dc005-876f-43ed-8625-b6f66b434eb1 req-bdc13a87-a405-4ca0-a39f-9349c2477923 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] No waiting events found dispatching network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:39 user nova-compute[74582]: WARNING nova.compute.manager [req-1c2dc005-876f-43ed-8625-b6f66b434eb1 req-bdc13a87-a405-4ca0-a39f-9349c2477923 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received unexpected event network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba for instance with vm_state building and task_state spawning.
Nov 03 14:05:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:05:41 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Instance spawned successfully.
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-84ed5acc-1660-4bef-b89c-76c6a11ca06d req-9e827cd7-095b-4eba-8e55-b4f85b0d2dd6 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84ed5acc-1660-4bef-b89c-76c6a11ca06d req-9e827cd7-095b-4eba-8e55-b4f85b0d2dd6 service nova] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84ed5acc-1660-4bef-b89c-76c6a11ca06d req-9e827cd7-095b-4eba-8e55-b4f85b0d2dd6 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-84ed5acc-1660-4bef-b89c-76c6a11ca06d req-9e827cd7-095b-4eba-8e55-b4f85b0d2dd6 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-84ed5acc-1660-4bef-b89c-76c6a11ca06d req-9e827cd7-095b-4eba-8e55-b4f85b0d2dd6 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] No waiting events found dispatching network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:41 user nova-compute[74582]: WARNING nova.compute.manager [req-84ed5acc-1660-4bef-b89c-76c6a11ca06d req-9e827cd7-095b-4eba-8e55-b4f85b0d2dd6 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received unexpected event network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba for instance with vm_state building and task_state spawning.
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:05:41 user nova-compute[74582]: INFO nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 03 14:05:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:05:41 user nova-compute[74582]: INFO nova.compute.manager [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Took 7.17 seconds to build instance.
Nov 03 14:05:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-4dc731f8-3076-440b-bcbb-26ca4d2396ed tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.288s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:47 user nova-compute[74582]: INFO nova.compute.manager [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Rebooting instance
Nov 03 14:05:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG nova.network.neutron [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG nova.network.neutron [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-74976b59-6b04-46c6-9121-6d95cf5a63ca req-07986553-5b70-4557-952a-73eb4a9bc69e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-unplugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-74976b59-6b04-46c6-9121-6d95cf5a63ca req-07986553-5b70-4557-952a-73eb4a9bc69e service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-74976b59-6b04-46c6-9121-6d95cf5a63ca req-07986553-5b70-4557-952a-73eb4a9bc69e service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-74976b59-6b04-46c6-9121-6d95cf5a63ca req-07986553-5b70-4557-952a-73eb4a9bc69e service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-74976b59-6b04-46c6-9121-6d95cf5a63ca req-07986553-5b70-4557-952a-73eb4a9bc69e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-unplugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:49 user nova-compute[74582]: WARNING nova.compute.manager [req-74976b59-6b04-46c6-9121-6d95cf5a63ca req-07986553-5b70-4557-952a-73eb4a9bc69e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-unplugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state active and task_state reboot_started_hard.
Nov 03 14:05:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance destroyed successfully.
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'resources' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687070852',display_name='tempest-TestMinimumBasicScenario-server-1687070852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687070852',id=31,image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXbt00hUhVjJka/8XJWIzVA/aV0ZDnlyeHXSd9zVxLtEsVmvJmpu5TbVD9WHOvl4YjmUhDJkjW/pJ/hjS/mkQ6NMOTQMBndodmqcfHsMdXZDdKQ16w9ZdlHzeY0+2GcTw==',key_name='tempest-TestMinimumBasicScenario-97236426',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-g3b17wod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:05:49Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=1b594495-ee96-4a48-a789-ab1d14135410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb5dbb6f-1c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11461843-f13c-440d-8372-4913df356caa) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:49 user nova-compute[74582]: INFO os_vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c')
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:49 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d23d18-d9bb-4746-b71c-d944658b0809]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:05:49 user nova-compute[74582]: No targets found.
Nov 03 14:05:49 user nova-compute[74582]: iSNS:
Nov 03 14:05:49 user nova-compute[74582]: No targets found.
Nov 03 14:05:49 user nova-compute[74582]: STATIC:
Nov 03 14:05:49 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:05:49 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:49 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:49 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:05:49 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:05:49 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:05:49 user nova-compute[74582]: FIRMWARE:
Nov 03 14:05:49 user nova-compute[74582]: No targets found.
Nov 03 14:05:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:05:49 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:05:49 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6fe024-3002-428a-a2e6-0cce60ef061e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a7f9c-18a8-490e-9254-cc88fd94e40f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:49 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:49 user nova-compute[74582]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68367ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a5e292-3d73-44c7-a46c-0f1385c5d1f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee03da-efd6-45dc-9fe9-60e0622755b4]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e1bb57-0bd4-444b-b251-b647ee73d8ee]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ea1a9c-550f-430b-8c54-2a6d5ec7c1b7]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c800864-fa2e-45a5-98ed-b85091df210d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4462ea3e-5386-4fb4-9606-c67b4384d14f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]
Nov 03 14:05:49 user nova-compute[74582]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1118b88-b53c-4b30-9540-cd4ec6cf544e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== disconnect_volume: return (313ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Start _get_guest_xml network_info=[{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=db79ffbd-73c1-4880-8895-06a5ba7cd25c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'db79ffbd-73c1-4880-8895-06a5ba7cd25c'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd0d40235-4a47-4186-af4c-c98e01fce7b4', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1b594495-ee96-4a48-a789-ab1d14135410', 'attached_at': '', 'detached_at': '', 'volume_id': 'b56d2602-8e5e-423c-96f5-5891b71c153f', 'serial': 'b56d2602-8e5e-423c-96f5-5891b71c153f'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:05:49 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:05:49 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=db79ffbd-73c1-4880-8895-06a5ba7cd25c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:49 user nova-compute[74582]: DEBUG nova.objects.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Object Instance<1b594495-ee96-4a48-a789-ab1d14135410> lazy-loaded attributes: resources,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:05:50 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:50 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:05:50 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb7462-302a-4f1b-8fe3-c9e412d1d6bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:05:50 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[be63a3cf-90f4-4680-9005-a07adddebd25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f] added
Nov 03 14:05:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[10674c04-7b7f-42c3-b685-350a9fc6c307]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.086s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9103ec0d-d453-4d22-9a10-8e7f2a3230c5]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgJYiPpK {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgJYiPpK" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f3f125-bd43-47c0-a9f2-e8f20daa863e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgJYiPpK'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[21abddab-c2cb-4c2e-87e3-012640ef9647]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfeb35c-8c6c-45c2-b7c6-81864f1b5d71]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9bc490-329e-4200-91ad-fdde5aa5f460]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]
Nov 03 14:05:50 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.
Nov 03 14:05:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b0ffc-7fcd-4970-a015-4cbfd17c2ee2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ceb29-7838-446f-b1e3-0076270115da]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:50 user nova-compute[74582]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:05:50 user nova-compute[74582]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:05:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce178669-fcdc-491f-8d11-c0cdd98d39a8]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:05:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-0c031ee8-a800-4cc4-a2c1-9f2396d4b8e0 req-516441af-5408-4ca8-8bac-6d56153ca1b2 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0c031ee8-a800-4cc4-a2c1-9f2396d4b8e0 req-516441af-5408-4ca8-8bac-6d56153ca1b2 service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0c031ee8-a800-4cc4-a2c1-9f2396d4b8e0 req-516441af-5408-4ca8-8bac-6d56153ca1b2 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0c031ee8-a800-4cc4-a2c1-9f2396d4b8e0 req-516441af-5408-4ca8-8bac-6d56153ca1b2 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-0c031ee8-a800-4cc4-a2c1-9f2396d4b8e0 req-516441af-5408-4ca8-8bac-6d56153ca1b2 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:51 user nova-compute[74582]: WARNING nova.compute.manager [req-0c031ee8-a800-4cc4-a2c1-9f2396d4b8e0 req-516441af-5408-4ca8-8bac-6d56153ca1b2 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state active and task_state reboot_started_hard.
Nov 03 14:05:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23333643036326230', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333643036326230', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687070852',display_name='tempest-TestMinimumBasicScenario-server-1687070852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687070852',id=31,image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXbt00hUhVjJka/8XJWIzVA/aV0ZDnlyeHXSd9zVxLtEsVmvJmpu5TbVD9WHOvl4YjmUhDJkjW/pJ/hjS/mkQ6NMOTQMBndodmqcfHsMdXZDdKQ16w9ZdlHzeY0+2GcTw==',key_name='tempest-TestMinimumBasicScenario-97236426',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-g3b17wod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:05:49Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=1b594495-ee96-4a48-a789-ab1d14135410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.objects.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Object Instance<1b594495-ee96-4a48-a789-ab1d14135410> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:05:51 user nova-compute[74582]:   <uuid>1b594495-ee96-4a48-a789-ab1d14135410</uuid>
Nov 03 14:05:51 user nova-compute[74582]:   <name>instance-0000001f</name>
Nov 03 14:05:51 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:05:51 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:05:51 user nova-compute[74582]:   <metadata>
Nov 03 14:05:51 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:05:51 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:05:51 user nova-compute[74582]:       <nova:name>tempest-TestMinimumBasicScenario-server-1687070852</nova:name>
Nov 03 14:05:51 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:05:49</nova:creationTime>
Nov 03 14:05:51 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:05:51 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:05:51 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:05:51 user nova-compute[74582]:       <nova:owner>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:user uuid="d63da82cd28e43849a1c8d8572385bf7">tempest-TestMinimumBasicScenario-1621292284-project-member</nova:user>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:project uuid="9069ac678f934449beb0ae6adf96911e">tempest-TestMinimumBasicScenario-1621292284</nova:project>
Nov 03 14:05:51 user nova-compute[74582]:       </nova:owner>
Nov 03 14:05:51 user nova-compute[74582]:       <nova:root type="image" uuid="db79ffbd-73c1-4880-8895-06a5ba7cd25c"/>
Nov 03 14:05:51 user nova-compute[74582]:       <nova:ports>
Nov 03 14:05:51 user nova-compute[74582]:         <nova:port uuid="eb5dbb6f-1cf8-4b3a-a747-275e16d52d75">
Nov 03 14:05:51 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 14:05:51 user nova-compute[74582]:         </nova:port>
Nov 03 14:05:51 user nova-compute[74582]:       </nova:ports>
Nov 03 14:05:51 user nova-compute[74582]:     </nova:instance>
Nov 03 14:05:51 user nova-compute[74582]:   </metadata>
Nov 03 14:05:51 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:05:51 user nova-compute[74582]:     <system>
Nov 03 14:05:51 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:05:51 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:05:51 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:05:51 user nova-compute[74582]:       <entry name="serial">1b594495-ee96-4a48-a789-ab1d14135410</entry>
Nov 03 14:05:51 user nova-compute[74582]:       <entry name="uuid">1b594495-ee96-4a48-a789-ab1d14135410</entry>
Nov 03 14:05:51 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:05:51 user nova-compute[74582]:     </system>
Nov 03 14:05:51 user nova-compute[74582]:   </sysinfo>
Nov 03 14:05:51 user nova-compute[74582]:   <os>
Nov 03 14:05:51 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:05:51 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:05:51 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:05:51 user nova-compute[74582]:   </os>
Nov 03 14:05:51 user nova-compute[74582]:   <features>
Nov 03 14:05:51 user nova-compute[74582]:     <acpi/>
Nov 03 14:05:51 user nova-compute[74582]:     <apic/>
Nov 03 14:05:51 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:05:51 user nova-compute[74582]:   </features>
Nov 03 14:05:51 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:05:51 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:05:51 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:05:51 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:05:51 user nova-compute[74582]:   </clock>
Nov 03 14:05:51 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:05:51 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:05:51 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:05:51 user nova-compute[74582]:   </cpu>
Nov 03 14:05:51 user nova-compute[74582]:   <devices>
Nov 03 14:05:51 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:05:51 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:05:51 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk"/>
Nov 03 14:05:51 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:05:51 user nova-compute[74582]:     </disk>
Nov 03 14:05:51 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:05:51 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:05:51 user nova-compute[74582]:       <source dev="/dev/sdc"/>
Nov 03 14:05:51 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:05:51 user nova-compute[74582]:       <serial>b56d2602-8e5e-423c-96f5-5891b71c153f</serial>
Nov 03 14:05:51 user nova-compute[74582]:     </disk>
Nov 03 14:05:51 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:05:51 user nova-compute[74582]:       <mac address="fa:16:3e:2f:e4:54"/>
Nov 03 14:05:51 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:05:51 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:05:51 user nova-compute[74582]:       <target dev="tapeb5dbb6f-1c"/>
Nov 03 14:05:51 user nova-compute[74582]:     </interface>
Nov 03 14:05:51 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:05:51 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/console.log" append="off"/>
Nov 03 14:05:51 user nova-compute[74582]:     </serial>
Nov 03 14:05:51 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:05:51 user nova-compute[74582]:     <video>
Nov 03 14:05:51 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:05:51 user nova-compute[74582]:     </video>
Nov 03 14:05:51 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:05:51 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:05:51 user nova-compute[74582]:     </rng>
Nov 03 14:05:51 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:05:51 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:05:51 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:05:51 user nova-compute[74582]:     </memballoon>
Nov 03 14:05:51 user nova-compute[74582]:   </devices>
Nov 03 14:05:51 user nova-compute[74582]: </domain>
Nov 03 14:05:51 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG nova.objects.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Object Instance<1b594495-ee96-4a48-a789-ab1d14135410> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:05:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Cannot resize image /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'migration_context' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.objects.base [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Object Instance<1b594495-ee96-4a48-a789-ab1d14135410> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687070852',display_name='tempest-TestMinimumBasicScenario-server-1687070852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687070852',id=31,image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXbt00hUhVjJka/8XJWIzVA/aV0ZDnlyeHXSd9zVxLtEsVmvJmpu5TbVD9WHOvl4YjmUhDJkjW/pJ/hjS/mkQ6NMOTQMBndodmqcfHsMdXZDdKQ16w9ZdlHzeY0+2GcTw==',key_name='tempest-TestMinimumBasicScenario-97236426',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-g3b17wod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:05:49Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=1b594495-ee96-4a48-a789-ab1d14135410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG os_vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ea17f3b-8c0c-54c5-bf77-36efa011b7c2', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb5dbb6f-1c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb5dbb6f-1c, col_values=(('qos', UUID('21ba1018-e952-47ff-ba26-87ffdbafa680')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb5dbb6f-1c, col_values=(('external_ids', {'iface-id': 'eb5dbb6f-1cf8-4b3a-a747-275e16d52d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e4:54', 'vm-uuid': '1b594495-ee96-4a48-a789-ab1d14135410'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:05:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:52 user nova-compute[74582]: INFO os_vif [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c')
Nov 03 14:05:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-6fd98f19-cc32-44c4-be52-377dcfff9c4c req-4b8a57c0-5fa6-4847-8137-70776382867e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6fd98f19-cc32-44c4-be52-377dcfff9c4c req-4b8a57c0-5fa6-4847-8137-70776382867e service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6fd98f19-cc32-44c4-be52-377dcfff9c4c req-4b8a57c0-5fa6-4847-8137-70776382867e service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6fd98f19-cc32-44c4-be52-377dcfff9c4c req-4b8a57c0-5fa6-4847-8137-70776382867e service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-6fd98f19-cc32-44c4-be52-377dcfff9c4c req-4b8a57c0-5fa6-4847-8137-70776382867e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:54 user nova-compute[74582]: WARNING nova.compute.manager [req-6fd98f19-cc32-44c4-be52-377dcfff9c4c req-4b8a57c0-5fa6-4847-8137-70776382867e service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state active and task_state reboot_started_hard.
Nov 03 14:05:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-1de5e0a6-6fe4-421d-a034-1dfd15849639 req-5103e690-691d-4f36-91da-75dab3793868 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1de5e0a6-6fe4-421d-a034-1dfd15849639 req-5103e690-691d-4f36-91da-75dab3793868 service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1de5e0a6-6fe4-421d-a034-1dfd15849639 req-5103e690-691d-4f36-91da-75dab3793868 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1de5e0a6-6fe4-421d-a034-1dfd15849639 req-5103e690-691d-4f36-91da-75dab3793868 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-1de5e0a6-6fe4-421d-a034-1dfd15849639 req-5103e690-691d-4f36-91da-75dab3793868 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:05:56 user nova-compute[74582]: WARNING nova.compute.manager [req-1de5e0a6-6fe4-421d-a034-1dfd15849639 req-5103e690-691d-4f36-91da-75dab3793868 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state active and task_state reboot_started_hard.
Nov 03 14:05:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:05:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance rebooted successfully.
Nov 03 14:05:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5f84e04e-6ff0-4eab-9fa1-9e394dfa68bf tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.537s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:05:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:05:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:05:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:06:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:06:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "66414a19-4a63-4621-82f2-33d5c60769cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:05 user nova-compute[74582]: INFO nova.compute.manager [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Terminating instance
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-d2573bd0-05c0-4763-a01b-48b9e74b2878 req-f153c0d5-8631-4e40-a991-97a26f9ad7a7 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-vif-unplugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d2573bd0-05c0-4763-a01b-48b9e74b2878 req-f153c0d5-8631-4e40-a991-97a26f9ad7a7 service nova] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d2573bd0-05c0-4763-a01b-48b9e74b2878 req-f153c0d5-8631-4e40-a991-97a26f9ad7a7 service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d2573bd0-05c0-4763-a01b-48b9e74b2878 req-f153c0d5-8631-4e40-a991-97a26f9ad7a7 service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-d2573bd0-05c0-4763-a01b-48b9e74b2878 req-f153c0d5-8631-4e40-a991-97a26f9ad7a7 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] No waiting events found dispatching network-vif-unplugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.compute.manager [req-d2573bd0-05c0-4763-a01b-48b9e74b2878 req-f153c0d5-8631-4e40-a991-97a26f9ad7a7 service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-vif-unplugged-89c47875-db7c-4b43-835c-82499860921a for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:06:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Instance destroyed successfully.
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'resources' on Instance uuid 66414a19-4a63-4621-82f2-33d5c60769cc {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1748059274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1748059274',id=23,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:56:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-0wa883fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:58:38Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=66414a19-4a63-4621-82f2-33d5c60769cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "89c47875-db7c-4b43-835c-82499860921a", "address": "fa:16:3e:8f:97:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89c47875-db", "ovs_interfaceid": "89c47875-db7c-4b43-835c-82499860921a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG os_vif [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89c47875-db, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30c719d2-bf7b-481a-923c-af49245ce661) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:05 user nova-compute[74582]: INFO os_vif [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:97:ac,bridge_name='br-int',has_traffic_filtering=True,id=89c47875-db7c-4b43-835c-82499860921a,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89c47875-db')
Nov 03 14:06:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Deleting instance files /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc_del
Nov 03 14:06:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Deletion of /opt/stack/data/nova/instances/66414a19-4a63-4621-82f2-33d5c60769cc_del complete
Nov 03 14:06:05 user nova-compute[74582]: INFO nova.compute.manager [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 14:06:05 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:06:05 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [{"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-da0950d0-3380-4104-8dca-023612958b01" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: da0950d0-3380-4104-8dca-023612958b01] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:06:06 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Took 0.46 seconds to deallocate network for instance.
Nov 03 14:06:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:06:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:06 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Deleted allocations for instance 66414a19-4a63-4621-82f2-33d5c60769cc
Nov 03 14:06:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c783a798-9c29-401c-af55-482b69f9ca84 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "66414a19-4a63-4621-82f2-33d5c60769cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:06:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] Acquiring lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] Lock "66414a19-4a63-4621-82f2-33d5c60769cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] No waiting events found dispatching network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:06:07 user nova-compute[74582]: WARNING nova.compute.manager [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received unexpected event network-vif-plugged-89c47875-db7c-4b43-835c-82499860921a for instance with vm_state deleted and task_state None.
Nov 03 14:06:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-4bf3a00a-23c2-47d6-aa6c-0e926dea2de3 req-cbfcca1d-2060-4117-95b9-7f3e1e0c270a service nova] [instance: 66414a19-4a63-4621-82f2-33d5c60769cc] Received event network-vif-deleted-89c47875-db7c-4b43-835c-82499860921a {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:06:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:06:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.177398681640625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance da0950d0-3380-4104-8dca-023612958b01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1b594495-ee96-4a48-a789-ab1d14135410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:06:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:06:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:06:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:06:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:51 user nova-compute[74582]: INFO nova.compute.manager [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Unshelving
Nov 03 14:06:51 user nova-compute[74582]: INFO nova.virt.block_device [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Booting with volume 42fa1d41-757f-4698-9f7f-b08067eb655b at /dev/vda
Nov 03 14:06:52 user nova-compute[74582]: DEBUG os_brick.utils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e29ff4b-af65-44ff-bf9d-ac85a90338cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c719af-708e-40db-a4ee-183851747e4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9d13a-6d54-48b2-a380-00de3e9842f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7465c-5aeb-4bb8-a950-3376eb8bd059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:06:52 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:06:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff41e0-4797-4557-ad39-24bcf0c20cec]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG os_brick.utils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:06:52 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating existing volume attachment record: 189272d6-a4af-4ac9-90d7-0552f2ea6d83 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "da0950d0-3380-4104-8dca-023612958b01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:55 user nova-compute[74582]: INFO nova.compute.manager [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Terminating instance
Nov 03 14:06:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-15cfc936-3b66-4a8a-891e-252567250837 req-08b5e678-ab85-42cf-abc1-b3b5bd49ecae service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-15cfc936-3b66-4a8a-891e-252567250837 req-08b5e678-ab85-42cf-abc1-b3b5bd49ecae service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-15cfc936-3b66-4a8a-891e-252567250837 req-08b5e678-ab85-42cf-abc1-b3b5bd49ecae service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-15cfc936-3b66-4a8a-891e-252567250837 req-08b5e678-ab85-42cf-abc1-b3b5bd49ecae service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-15cfc936-3b66-4a8a-891e-252567250837 req-08b5e678-ab85-42cf-abc1-b3b5bd49ecae service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-15cfc936-3b66-4a8a-891e-252567250837 req-08b5e678-ab85-42cf-abc1-b3b5bd49ecae service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-unplugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Instance destroyed successfully.
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.objects.instance [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'resources' on Instance uuid da0950d0-3380-4104-8dca-023612958b01 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-901676576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-901676576',id=13,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-rnq0c0yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:54:56Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=da0950d0-3380-4104-8dca-023612958b01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "1609f201-4161-4c46-95a4-f307a062ee0f", "address": "fa:16:3e:56:8d:ac", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609f201-41", "ovs_interfaceid": "1609f201-4161-4c46-95a4-f307a062ee0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_vif [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1609f201-41, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb9bf58b-3e1d-4920-8313-3bc7fde3d706) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:06:56 user nova-compute[74582]: INFO os_vif [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:8d:ac,bridge_name='br-int',has_traffic_filtering=True,id=1609f201-4161-4c46-95a4-f307a062ee0f,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609f201-41')
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfEkADGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:06:56 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[18073cc5-3e8c-4f9f-bc67-22b9cdb844fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:06:56 user nova-compute[74582]: No targets found.
Nov 03 14:06:56 user nova-compute[74582]: iSNS:
Nov 03 14:06:56 user nova-compute[74582]: No targets found.
Nov 03 14:06:56 user nova-compute[74582]: STATIC:
Nov 03 14:06:56 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:06:56 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:06:56 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:06:56 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856
Nov 03 14:06:56 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:06:56 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:06:56 user nova-compute[74582]: FIRMWARE:
Nov 03 14:06:56 user nova-compute[74582]: No targets found.
Nov 03 14:06:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:06:56 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:06:56 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa623f-ac83-461f-a3ef-83b0aee0a682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2147421-d2a5-4414-b9f6-2daab196d187]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:06:56 user nova-compute[74582]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:06:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 (non-flash)
Nov 03 14:06:56 user nova-compute[74582]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:06:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f487ba320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[57296517-b404-47f5-8644-6eb51448d4d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0a71f-0e66-4d62-911a-8ef14d2b1cd6]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa1ddcf-0436-4417-aba3-41c25f7ee418]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e84bd-d0ae-4b88-8db9-a121358cc2b2]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[311039a3-29f7-4d84-a74b-25933e2a5a94]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e6deb0-433f-43cb-a43f-deff8e884553]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260]
Nov 03 14:06:56 user nova-compute[74582]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856, portal: 172.16.0.220,3260] successful.
Nov 03 14:06:56 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e21104-72e8-4171-8f72-2293706ab856 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa46d2f-6906-459f-8c2c-5fd6932f73ba]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] <== disconnect_volume: return (330ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:06:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:06:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Deleting instance files /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01_del
Nov 03 14:06:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Deletion of /opt/stack/data/nova/instances/da0950d0-3380-4104-8dca-023612958b01_del complete
Nov 03 14:06:57 user nova-compute[74582]: INFO nova.compute.manager [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 03 14:06:57 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:06:57 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:06:57 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: da0950d0-3380-4104-8dca-023612958b01] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:06:57 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:06:57 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: da0950d0-3380-4104-8dca-023612958b01] Took 0.54 seconds to deallocate network for instance.
Nov 03 14:06:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-1f1ca33a-3dfb-4781-8ce3-3cce5cd6fc21 req-b4e77ab1-3178-4a2a-9730-243112c6d4ff service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-deleted-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:06:57 user nova-compute[74582]: INFO nova.compute.manager [req-1f1ca33a-3dfb-4781-8ce3-3cce5cd6fc21 req-b4e77ab1-3178-4a2a-9730-243112c6d4ff service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Neutron deleted interface 1609f201-4161-4c46-95a4-f307a062ee0f; detaching it from the instance and deleting it from the info cache
Nov 03 14:06:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-1f1ca33a-3dfb-4781-8ce3-3cce5cd6fc21 req-b4e77ab1-3178-4a2a-9730-243112c6d4ff service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:06:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-1f1ca33a-3dfb-4781-8ce3-3cce5cd6fc21 req-b4e77ab1-3178-4a2a-9730-243112c6d4ff service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Detach interface failed, port_id=1609f201-4161-4c46-95a4-f307a062ee0f, reason: Instance da0950d0-3380-4104-8dca-023612958b01 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:06:57 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-d5f592cc-72e9-4191-bf11-d11d0857d215 req-33e35faa-3ceb-4b0f-a548-b7e5140123d1 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d5f592cc-72e9-4191-bf11-d11d0857d215 req-33e35faa-3ceb-4b0f-a548-b7e5140123d1 service nova] Acquiring lock "da0950d0-3380-4104-8dca-023612958b01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d5f592cc-72e9-4191-bf11-d11d0857d215 req-33e35faa-3ceb-4b0f-a548-b7e5140123d1 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d5f592cc-72e9-4191-bf11-d11d0857d215 req-33e35faa-3ceb-4b0f-a548-b7e5140123d1 service nova] Lock "da0950d0-3380-4104-8dca-023612958b01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-d5f592cc-72e9-4191-bf11-d11d0857d215 req-33e35faa-3ceb-4b0f-a548-b7e5140123d1 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] No waiting events found dispatching network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:06:58 user nova-compute[74582]: WARNING nova.compute.manager [req-d5f592cc-72e9-4191-bf11-d11d0857d215 req-33e35faa-3ceb-4b0f-a548-b7e5140123d1 service nova] [instance: da0950d0-3380-4104-8dca-023612958b01] Received unexpected event network-vif-plugged-1609f201-4161-4c46-95a4-f307a062ee0f for instance with vm_state active and task_state deleting.
Nov 03 14:06:58 user nova-compute[74582]: INFO nova.compute.manager [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: da0950d0-3380-4104-8dca-023612958b01] Took 0.93 seconds to detach 1 volumes for instance.
Nov 03 14:06:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:06:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:58 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Deleted allocations for instance da0950d0-3380-4104-8dca-023612958b01
Nov 03 14:06:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd92d976-f49c-4380-8dfb-fead55113982 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "da0950d0-3380-4104-8dca-023612958b01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.364s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:06:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:06:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:07:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:07:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:07:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:07:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:07:12 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8263MB free_disk=25.154537200927734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1b594495-ee96-4a48-a789-ab1d14135410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ce4dda5c-bd2b-4bce-9def-e076b5b2106a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.objects.instance [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'pci_requests' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.objects.instance [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'numa_topology' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:07:13 user nova-compute[74582]: INFO nova.compute.claims [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Claim successful on node user
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:07:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:13 user nova-compute[74582]: INFO nova.network.neutron [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating port b187fce7-d381-4707-8cc7-8b6497cdaacb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing instance network info cache due to event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:07:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.network.neutron [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:07:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Creating image(s)
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Ensure instance console log exists: /opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Start _get_guest_xml network_info=[{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '189272d6-a4af-4ac9-90d7-0552f2ea6d83', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce4dda5c-bd2b-4bce-9def-e076b5b2106a', 'attached_at': '', 'detached_at': '', 'volume_id': '42fa1d41-757f-4698-9f7f-b08067eb655b', 'serial': '42fa1d41-757f-4698-9f7f-b08067eb655b'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.network.neutron [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:07:15 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:07:15 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.objects.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Object Instance<ce4dda5c-bd2b-4bce-9def-e076b5b2106a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:07:15 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:07:15 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:07:15 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4171ee1-19ca-4c86-ab25-bac65d1f49d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:07:15 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c770a-45ee-49b3-9629-435d6694ff5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b] added
Nov 03 14:07:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d1426-a6fb-4ba1-a976-759b2d3ff2b1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f9557-3e82-43cd-96c5-8fa004689f06]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeDJzhFW {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeDJzhFW" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13de92f-5596-42f5-b369-99b9eee8ec30]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yeDJzhFW'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[77214a41-4a22-4645-b019-d9cbcbec5f0d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b7fe1-cb7d-4ef3-8d83-8edb236b59e3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b841c505-92d7-4b99-88d3-ab3c0a5a3650]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]
Nov 03 14:07:15 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.
Nov 03 14:07:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c96a83-5ed3-4952-8e5a-b5872ed7bda1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c577f-8419-4d1f-95c3-d283f0c3cb37]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:15 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:07:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:15 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:07:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b6c61-5bb0-4b32-80d0-6cab9dcb9dab]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updated VIF entry in instance network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-acc172f8-897b-45cc-80bc-bcb40cadcf54 req-25d376a0-4090-4e4a-8cf6-689bae7454b5 service nova] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26631623061383436', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631623061383436', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T14:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-232847620',display_name='tempest-TestShelveInstance-server-232847620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-232847620',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1970729209',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bc9bce1e208f4b809df3cd71cccf1064',ramdisk_id='',reservation_id='r-mo0t1e8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159972837',owner_user_name='tempest-TestShelveInstance-1159972837-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:06:52Z,user_data=None,user_id='1b40b982348e4a42be1953ce067bd977',uuid=ce4dda5c-bd2b-4bce-9def-e076b5b2106a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converting VIF {"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.objects.instance [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'pci_devices' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.objects.base [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Object Instance<ce4dda5c-bd2b-4bce-9def-e076b5b2106a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:07:16 user nova-compute[74582]:   <uuid>ce4dda5c-bd2b-4bce-9def-e076b5b2106a</uuid>
Nov 03 14:07:16 user nova-compute[74582]:   <name>instance-0000001d</name>
Nov 03 14:07:16 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:07:16 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:07:16 user nova-compute[74582]:   <metadata>
Nov 03 14:07:16 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:07:16 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:07:16 user nova-compute[74582]:       <nova:name>tempest-TestShelveInstance-server-232847620</nova:name>
Nov 03 14:07:16 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:07:15</nova:creationTime>
Nov 03 14:07:16 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:07:16 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:07:16 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:07:16 user nova-compute[74582]:       <nova:owner>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:user uuid="1b40b982348e4a42be1953ce067bd977">tempest-TestShelveInstance-1159972837-project-member</nova:user>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:project uuid="bc9bce1e208f4b809df3cd71cccf1064">tempest-TestShelveInstance-1159972837</nova:project>
Nov 03 14:07:16 user nova-compute[74582]:       </nova:owner>
Nov 03 14:07:16 user nova-compute[74582]:       <nova:ports>
Nov 03 14:07:16 user nova-compute[74582]:         <nova:port uuid="b187fce7-d381-4707-8cc7-8b6497cdaacb">
Nov 03 14:07:16 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 14:07:16 user nova-compute[74582]:         </nova:port>
Nov 03 14:07:16 user nova-compute[74582]:       </nova:ports>
Nov 03 14:07:16 user nova-compute[74582]:     </nova:instance>
Nov 03 14:07:16 user nova-compute[74582]:   </metadata>
Nov 03 14:07:16 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:07:16 user nova-compute[74582]:     <system>
Nov 03 14:07:16 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:07:16 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:07:16 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:07:16 user nova-compute[74582]:       <entry name="serial">ce4dda5c-bd2b-4bce-9def-e076b5b2106a</entry>
Nov 03 14:07:16 user nova-compute[74582]:       <entry name="uuid">ce4dda5c-bd2b-4bce-9def-e076b5b2106a</entry>
Nov 03 14:07:16 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:07:16 user nova-compute[74582]:     </system>
Nov 03 14:07:16 user nova-compute[74582]:   </sysinfo>
Nov 03 14:07:16 user nova-compute[74582]:   <os>
Nov 03 14:07:16 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:07:16 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:07:16 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:07:16 user nova-compute[74582]:   </os>
Nov 03 14:07:16 user nova-compute[74582]:   <features>
Nov 03 14:07:16 user nova-compute[74582]:     <acpi/>
Nov 03 14:07:16 user nova-compute[74582]:     <apic/>
Nov 03 14:07:16 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:07:16 user nova-compute[74582]:   </features>
Nov 03 14:07:16 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:07:16 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:07:16 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:07:16 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:07:16 user nova-compute[74582]:   </clock>
Nov 03 14:07:16 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:07:16 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:07:16 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:07:16 user nova-compute[74582]:   </cpu>
Nov 03 14:07:16 user nova-compute[74582]:   <devices>
Nov 03 14:07:16 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:07:16 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:07:16 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 14:07:16 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:07:16 user nova-compute[74582]:       <serial>42fa1d41-757f-4698-9f7f-b08067eb655b</serial>
Nov 03 14:07:16 user nova-compute[74582]:     </disk>
Nov 03 14:07:16 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:07:16 user nova-compute[74582]:       <mac address="fa:16:3e:4d:0e:56"/>
Nov 03 14:07:16 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:07:16 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:07:16 user nova-compute[74582]:       <target dev="tapb187fce7-d3"/>
Nov 03 14:07:16 user nova-compute[74582]:     </interface>
Nov 03 14:07:16 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:07:16 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a/console.log" append="off"/>
Nov 03 14:07:16 user nova-compute[74582]:     </serial>
Nov 03 14:07:16 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:07:16 user nova-compute[74582]:     <video>
Nov 03 14:07:16 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:07:16 user nova-compute[74582]:     </video>
Nov 03 14:07:16 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:07:16 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:07:16 user nova-compute[74582]:     </rng>
Nov 03 14:07:16 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:07:16 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:07:16 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:07:16 user nova-compute[74582]:     </memballoon>
Nov 03 14:07:16 user nova-compute[74582]:   </devices>
Nov 03 14:07:16 user nova-compute[74582]: </domain>
Nov 03 14:07:16 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T14:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-232847620',display_name='tempest-TestShelveInstance-server-232847620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-232847620',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1970729209',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bc9bce1e208f4b809df3cd71cccf1064',ramdisk_id='',reservation_id='r-mo0t1e8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159972837',owner_user_name='tempest-TestShelveInstance-1159972837-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:06:52Z,user_data=None,user_id='1b40b982348e4a42be1953ce067bd977',uuid=ce4dda5c-bd2b-4bce-9def-e076b5b2106a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converting VIF {"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG os_vif [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a88c7a63-3835-5321-819d-d956c11b2847', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb187fce7-d3, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb187fce7-d3, col_values=(('qos', UUID('ce025b6c-3ac7-4c60-b556-c52dc0d3b8dc')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb187fce7-d3, col_values=(('external_ids', {'iface-id': 'b187fce7-d381-4707-8cc7-8b6497cdaacb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:0e:56', 'vm-uuid': 'ce4dda5c-bd2b-4bce-9def-e076b5b2106a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:16 user nova-compute[74582]: INFO os_vif [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3')
Nov 03 14:07:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:07:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] No VIF found with MAC fa:16:3e:4d:0e:56, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:07:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:07:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:07:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance spawned successfully.
Nov 03 14:07:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:07:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27e71f72-bc48-444a-aa17-f784455c9322 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.063s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:07:21 user nova-compute[74582]: INFO nova.compute.claims [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Claim successful on node user
Nov 03 14:07:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:07:21 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.policy [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e2d0bf6ce5845209edecb631b24433d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f304de49fe4b2da95e3ea87508b5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:07:21 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Creating image(s)
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "/opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "/opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "/opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.233s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk 1073741824" returned: 0 in 0.054s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.272s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Cannot resize image /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Ensure instance console log exists: /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Successfully created port: fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:07:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-bb35d857-fdd4-4939-a5b4-b5878ae829c0 req-7ab8bf95-0971-4734-a2d9-8bb79d6e9d5d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bb35d857-fdd4-4939-a5b4-b5878ae829c0 req-7ab8bf95-0971-4734-a2d9-8bb79d6e9d5d service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bb35d857-fdd4-4939-a5b4-b5878ae829c0 req-7ab8bf95-0971-4734-a2d9-8bb79d6e9d5d service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bb35d857-fdd4-4939-a5b4-b5878ae829c0 req-7ab8bf95-0971-4734-a2d9-8bb79d6e9d5d service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-bb35d857-fdd4-4939-a5b4-b5878ae829c0 req-7ab8bf95-0971-4734-a2d9-8bb79d6e9d5d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:07:23 user nova-compute[74582]: WARNING nova.compute.manager [req-bb35d857-fdd4-4939-a5b4-b5878ae829c0 req-7ab8bf95-0971-4734-a2d9-8bb79d6e9d5d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state active and task_state None.
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Successfully updated port: fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquired lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-changed-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Refreshing instance network info cache due to event network-changed-fe6be05a-ae7a-4022-b40e-faba879bc06f. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] Acquiring lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating instance_info_cache with network_info: [{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Releasing lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance network_info: |[{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] Acquired lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.neutron [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Refreshing network info cache for port fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Start _get_guest_xml network_info=[{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:07:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:07:24 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-395639538',display_name='tempest-ServerActionsTestOtherB-server-395639538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-395639538',id=33,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHc9/jbfunoqVsUhLUu1pjLoR0V9zAk2xJMMTcjnRQGzg8BfzopXdOQ8CMQsm/bnvhMZdrP/DcHwcZwnlASxD9QF6FDnyfFwLjY5dKNP3gjQUH+twCkAlnrIC7JY2BNGg==',key_name='tempest-keypair-138063646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9f304de49fe4b2da95e3ea87508b5f7',ramdisk_id='',reservation_id='r-0ybfq9xk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1210177191',owner_user_name='tempest-ServerActionsTestOtherB-1210177191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2d0bf6ce5845209edecb631b24433d',uuid=339e891c-da3f-46a3-8303-0d88bb770627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converting VIF {"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.objects.instance [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lazy-loading 'pci_devices' on Instance uuid 339e891c-da3f-46a3-8303-0d88bb770627 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:07:24 user nova-compute[74582]:   <uuid>339e891c-da3f-46a3-8303-0d88bb770627</uuid>
Nov 03 14:07:24 user nova-compute[74582]:   <name>instance-00000021</name>
Nov 03 14:07:24 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:07:24 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:07:24 user nova-compute[74582]:   <metadata>
Nov 03 14:07:24 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:07:24 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:07:24 user nova-compute[74582]:       <nova:name>tempest-ServerActionsTestOtherB-server-395639538</nova:name>
Nov 03 14:07:24 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:07:24</nova:creationTime>
Nov 03 14:07:24 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:07:24 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:07:24 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:07:24 user nova-compute[74582]:       <nova:owner>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:user uuid="9e2d0bf6ce5845209edecb631b24433d">tempest-ServerActionsTestOtherB-1210177191-project-member</nova:user>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:project uuid="e9f304de49fe4b2da95e3ea87508b5f7">tempest-ServerActionsTestOtherB-1210177191</nova:project>
Nov 03 14:07:24 user nova-compute[74582]:       </nova:owner>
Nov 03 14:07:24 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:07:24 user nova-compute[74582]:       <nova:ports>
Nov 03 14:07:24 user nova-compute[74582]:         <nova:port uuid="fe6be05a-ae7a-4022-b40e-faba879bc06f">
Nov 03 14:07:24 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 14:07:24 user nova-compute[74582]:         </nova:port>
Nov 03 14:07:24 user nova-compute[74582]:       </nova:ports>
Nov 03 14:07:24 user nova-compute[74582]:     </nova:instance>
Nov 03 14:07:24 user nova-compute[74582]:   </metadata>
Nov 03 14:07:24 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:07:24 user nova-compute[74582]:     <system>
Nov 03 14:07:24 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:07:24 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:07:24 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:07:24 user nova-compute[74582]:       <entry name="serial">339e891c-da3f-46a3-8303-0d88bb770627</entry>
Nov 03 14:07:24 user nova-compute[74582]:       <entry name="uuid">339e891c-da3f-46a3-8303-0d88bb770627</entry>
Nov 03 14:07:24 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:07:24 user nova-compute[74582]:     </system>
Nov 03 14:07:24 user nova-compute[74582]:   </sysinfo>
Nov 03 14:07:24 user nova-compute[74582]:   <os>
Nov 03 14:07:24 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:07:24 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:07:24 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:07:24 user nova-compute[74582]:   </os>
Nov 03 14:07:24 user nova-compute[74582]:   <features>
Nov 03 14:07:24 user nova-compute[74582]:     <acpi/>
Nov 03 14:07:24 user nova-compute[74582]:     <apic/>
Nov 03 14:07:24 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:07:24 user nova-compute[74582]:   </features>
Nov 03 14:07:24 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:07:24 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:07:24 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:07:24 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:07:24 user nova-compute[74582]:   </clock>
Nov 03 14:07:24 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:07:24 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:07:24 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:07:24 user nova-compute[74582]:   </cpu>
Nov 03 14:07:24 user nova-compute[74582]:   <devices>
Nov 03 14:07:24 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:07:24 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:07:24 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk"/>
Nov 03 14:07:24 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:07:24 user nova-compute[74582]:     </disk>
Nov 03 14:07:24 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:07:24 user nova-compute[74582]:       <mac address="fa:16:3e:6d:8d:13"/>
Nov 03 14:07:24 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:07:24 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:07:24 user nova-compute[74582]:       <target dev="tapfe6be05a-ae"/>
Nov 03 14:07:24 user nova-compute[74582]:     </interface>
Nov 03 14:07:24 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:07:24 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/console.log" append="off"/>
Nov 03 14:07:24 user nova-compute[74582]:     </serial>
Nov 03 14:07:24 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:07:24 user nova-compute[74582]:     <video>
Nov 03 14:07:24 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:07:24 user nova-compute[74582]:     </video>
Nov 03 14:07:24 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:07:24 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:07:24 user nova-compute[74582]:     </rng>
Nov 03 14:07:24 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:07:24 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:07:24 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:07:24 user nova-compute[74582]:     </memballoon>
Nov 03 14:07:24 user nova-compute[74582]:   </devices>
Nov 03 14:07:24 user nova-compute[74582]: </domain>
Nov 03 14:07:24 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-395639538',display_name='tempest-ServerActionsTestOtherB-server-395639538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-395639538',id=33,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHc9/jbfunoqVsUhLUu1pjLoR0V9zAk2xJMMTcjnRQGzg8BfzopXdOQ8CMQsm/bnvhMZdrP/DcHwcZwnlASxD9QF6FDnyfFwLjY5dKNP3gjQUH+twCkAlnrIC7JY2BNGg==',key_name='tempest-keypair-138063646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9f304de49fe4b2da95e3ea87508b5f7',ramdisk_id='',reservation_id='r-0ybfq9xk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1210177191',owner_user_name='tempest-ServerActionsTestOtherB-1210177191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2d0bf6ce5845209edecb631b24433d',uuid=339e891c-da3f-46a3-8303-0d88bb770627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converting VIF {"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG os_vif [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2862138-e003-583e-85c2-39294f9f8d77', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe6be05a-ae, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe6be05a-ae, col_values=(('qos', UUID('61b512c9-811e-453a-bf88-b1fba8f7ba71')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe6be05a-ae, col_values=(('external_ids', {'iface-id': 'fe6be05a-ae7a-4022-b40e-faba879bc06f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:8d:13', 'vm-uuid': '339e891c-da3f-46a3-8303-0d88bb770627'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:24 user nova-compute[74582]: INFO os_vif [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae')
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:07:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] No VIF found with MAC fa:16:3e:6d:8d:13, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updated VIF entry in instance network info cache for port fe6be05a-ae7a-4022-b40e-faba879bc06f. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating instance_info_cache with network_info: [{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fa97a6d9-4a46-4ff0-8907-cc35b2387590 req-7b159924-576c-4b5e-b26c-33fae73c9178 service nova] Releasing lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-6e7dbd5b-973a-4f94-9243-2990a2ba9c3a req-20fcb05b-413c-4018-a27d-184130e842bc service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6e7dbd5b-973a-4f94-9243-2990a2ba9c3a req-20fcb05b-413c-4018-a27d-184130e842bc service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6e7dbd5b-973a-4f94-9243-2990a2ba9c3a req-20fcb05b-413c-4018-a27d-184130e842bc service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6e7dbd5b-973a-4f94-9243-2990a2ba9c3a req-20fcb05b-413c-4018-a27d-184130e842bc service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-6e7dbd5b-973a-4f94-9243-2990a2ba9c3a req-20fcb05b-413c-4018-a27d-184130e842bc service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:07:25 user nova-compute[74582]: WARNING nova.compute.manager [req-6e7dbd5b-973a-4f94-9243-2990a2ba9c3a req-20fcb05b-413c-4018-a27d-184130e842bc service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state active and task_state None.
Nov 03 14:07:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-82eede1e-dffe-4ef1-b68d-212741812346 req-acff143b-c646-4f99-974a-184050823335 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-82eede1e-dffe-4ef1-b68d-212741812346 req-acff143b-c646-4f99-974a-184050823335 service nova] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-82eede1e-dffe-4ef1-b68d-212741812346 req-acff143b-c646-4f99-974a-184050823335 service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-82eede1e-dffe-4ef1-b68d-212741812346 req-acff143b-c646-4f99-974a-184050823335 service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-82eede1e-dffe-4ef1-b68d-212741812346 req-acff143b-c646-4f99-974a-184050823335 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] No waiting events found dispatching network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:07:26 user nova-compute[74582]: WARNING nova.compute.manager [req-82eede1e-dffe-4ef1-b68d-212741812346 req-acff143b-c646-4f99-974a-184050823335 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received unexpected event network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f for instance with vm_state building and task_state spawning.
Nov 03 14:07:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-changed-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Refreshing instance network info cache due to event network-changed-4a0d26f3-2c5f-4e94-945c-89ef74798cba. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] Acquiring lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] Acquired lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Refreshing network info cache for port 4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'flavor' on Instance uuid 8f30eb65-1553-4f18-a861-b97e58dda769 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:28 user nova-compute[74582]: INFO nova.compute.manager [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Attaching volume 894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 to /dev/vdb
Nov 03 14:07:28 user nova-compute[74582]: DEBUG os_brick.utils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[464a6e17-483a-47c8-b892-02c81578a0cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updated VIF entry in instance network info cache for port 4a0d26f3-2c5f-4e94-945c-89ef74798cba. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG nova.network.neutron [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating instance_info_cache with network_info: [{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b86d8b-b65f-49e6-b36e-0955222d498b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9343d7f-19ce-41c7-84c3-62b21b3e1e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13fc7904-230f-4f79-925c-8367a24f434c req-640dc84a-b764-492d-8617-ccf758c80e48 service nova] Releasing lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d283abb-d77a-4b81-87cc-0b3e2a129c00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:07:28 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:07:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294d56a-9630-46e0-aa61-cb3aa460d54e]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG os_brick.utils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:07:28 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating existing volume attachment record: 03028ca4-3c62-4852-8eed-ae0a98b0de88 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-b46121a2-3bb3-4960-99bb-96202f6f8fd7 req-72d7139d-81d0-442a-810f-72a59a21c397 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b46121a2-3bb3-4960-99bb-96202f6f8fd7 req-72d7139d-81d0-442a-810f-72a59a21c397 service nova] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b46121a2-3bb3-4960-99bb-96202f6f8fd7 req-72d7139d-81d0-442a-810f-72a59a21c397 service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b46121a2-3bb3-4960-99bb-96202f6f8fd7 req-72d7139d-81d0-442a-810f-72a59a21c397 service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.compute.manager [req-b46121a2-3bb3-4960-99bb-96202f6f8fd7 req-72d7139d-81d0-442a-810f-72a59a21c397 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] No waiting events found dispatching network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:07:29 user nova-compute[74582]: WARNING nova.compute.manager [req-b46121a2-3bb3-4960-99bb-96202f6f8fd7 req-72d7139d-81d0-442a-810f-72a59a21c397 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received unexpected event network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f for instance with vm_state building and task_state spawning.
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:07:29 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance spawned successfully.
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:07:29 user nova-compute[74582]: INFO nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Took 7.61 seconds to spawn the instance on the hypervisor.
Nov 03 14:07:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:07:29 user nova-compute[74582]: INFO nova.compute.manager [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Took 8.52 seconds to build instance.
Nov 03 14:07:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-81a8d323-b378-4202-b1e6-f8e9f370d2be tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.638s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing instance network info cache due to event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:07:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:40 user nova-compute[74582]: DEBUG nova.network.neutron [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG nova.network.neutron [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updated VIF entry in instance network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG nova.network.neutron [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8507aeb8-c776-416f-84af-3a3efa8afd35 req-70d183df-6466-44e9-bedd-754ec90c79b8 service nova] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing instance network info cache due to event network-changed-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:07:41 user nova-compute[74582]: DEBUG nova.network.neutron [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Refreshing network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:42 user nova-compute[74582]: INFO nova.compute.manager [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Detaching volume b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:07:42 user nova-compute[74582]: INFO nova.virt.block_device [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Attempting to driver detach volume b56d2602-8e5e-423c-96f5-5891b71c153f from mountpoint /dev/vdb
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Attempting to detach device vdb from instance 1b594495-ee96-4a48-a789-ab1d14135410 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:07:42 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:07:42 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:07:42 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:07:42 user nova-compute[74582]:   <serial>b56d2602-8e5e-423c-96f5-5891b71c153f</serial>
Nov 03 14:07:42 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 14:07:42 user nova-compute[74582]: </disk>
Nov 03 14:07:42 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:07:42 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully detached device vdb from instance 1b594495-ee96-4a48-a789-ab1d14135410 from the persistent domain config.
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b594495-ee96-4a48-a789-ab1d14135410 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:07:42 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:07:42 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:07:42 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:07:42 user nova-compute[74582]:   <serial>b56d2602-8e5e-423c-96f5-5891b71c153f</serial>
Nov 03 14:07:42 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 14:07:42 user nova-compute[74582]: </disk>
Nov 03 14:07:42 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updated VIF entry in instance network info cache for port eb5dbb6f-1cf8-4b3a-a747-275e16d52d75. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf626bcf-5f96-402e-9adb-3c8ec9022ebd req-51387e2b-df2c-48ef-86ad-eab1ef475d01 service nova] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:07:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:07:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:46 user nova-compute[74582]: INFO nova.compute.manager [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Terminating instance
Nov 03 14:07:46 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Instance destroyed successfully.
Nov 03 14:07:47 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lazy-loading 'resources' on Instance uuid 76c90aa2-a787-434b-8dfd-d851ecf3cb17 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291632784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291632784',id=1,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc44a2fb46b4a649544d7e506a2d96b',ramdisk_id='',reservation_id='r-hi2m6bb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-412298968',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:49:14Z,user_data=None,user_id='e900eb8f4f6548f183010bc08a3c66f4',uuid=76c90aa2-a787-434b-8dfd-d851ecf3cb17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converting VIF {"id": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "address": "fa:16:3e:4e:bf:1e", "network": {"id": "82f9a621-8f0e-4a10-83bf-614e2f8aeb5c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1829372081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc44a2fb46b4a649544d7e506a2d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa3be249-1a", "ovs_interfaceid": "aa3be249-1ae2-4fff-a10d-ca3c0f4766c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG os_vif [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa3be249-1a, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca07a550-aa4a-4ba6-8cc4-d1a268b56e49) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:07:47 user nova-compute[74582]: INFO os_vif [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:bf:1e,bridge_name='br-int',has_traffic_filtering=True,id=aa3be249-1ae2-4fff-a10d-ca3c0f4766c0,network=Network(82f9a621-8f0e-4a10-83bf-614e2f8aeb5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa3be249-1a')
Nov 03 14:07:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Deleting instance files /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17_del
Nov 03 14:07:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Deletion of /opt/stack/data/nova/instances/76c90aa2-a787-434b-8dfd-d851ecf3cb17_del complete
Nov 03 14:07:47 user nova-compute[74582]: INFO nova.compute.manager [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 03 14:07:47 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:07:47 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:07:48 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Took 0.82 seconds to deallocate network for instance.
Nov 03 14:07:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-0ec5c34e-9e21-4e83-a2c9-2ce8e6d13310 req-38295c44-c361-4091-b956-70c9e5ee8ee2 service nova] [instance: 76c90aa2-a787-434b-8dfd-d851ecf3cb17] Received event network-vif-deleted-aa3be249-1ae2-4fff-a10d-ca3c0f4766c0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:48 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Deleted allocations for instance 76c90aa2-a787-434b-8dfd-d851ecf3cb17
Nov 03 14:07:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee633c86-914f-428a-ba95-dc2301524dc5 tempest-ServerBootFromVolumeStableRescueTest-412298968 tempest-ServerBootFromVolumeStableRescueTest-412298968-project-member] Lock "76c90aa2-a787-434b-8dfd-d851ecf3cb17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZmfkKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:07:51 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:07:51 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:07:51 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b363a0a4-6297-4aaa-8d82-5bc3463fc245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:07:51 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ce57af-f23e-4d7f-8a45-8ac3dc041d7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5] added
Nov 03 14:07:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a76f0de-2980-49e8-8eb4-2cbc1e27c227]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c0c4f2-36d2-4e57-aacb-9156067fee64]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaZmfkKz {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaZmfkKz" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90178ae-8070-4249-bbe4-727d8754c1a7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaZmfkKz'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c78b2-3e18-43f1-b6ed-5d52c43c72cc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed05b7-e3bb-4e11-bfdd-1862aee4a9fd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:52 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:07:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:52 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:07:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d921a59-d621-40b8-8cd1-fff68b1530bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260]
Nov 03 14:07:52 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260] successful.
Nov 03 14:07:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6b382b-c9f3-4f52-8d2f-bb7dfcaa9c20]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fba640-819b-4536-9cd1-fe7135c5b809]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:52 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:07:52 user nova-compute[74582]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)
Nov 03 14:07:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:07:52 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:07:52 user nova-compute[74582]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)
Nov 03 14:07:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbfd046-3a7b-47b3-8a27-c9ab5d516c1e]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:07:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZmfkKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26431633666313530', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431633666313530', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'flavor' on Instance uuid 8f30eb65-1553-4f18-a861-b97e58dda769 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:07:53 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:07:53 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:07:53 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:07:53 user nova-compute[74582]:   <serial>894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5</serial>
Nov 03 14:07:53 user nova-compute[74582]: </disk>
Nov 03 14:07:53 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No VIF found with MAC fa:16:3e:f6:33:2b, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:07:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f322588a-aff7-4485-a2ac-ca436be9f7c2 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.777s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:07:54 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:07:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 0 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:07:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:07:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:07:56 user nova-compute[74582]: INFO nova.compute.manager [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Detaching volume 894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5
Nov 03 14:07:56 user nova-compute[74582]: INFO nova.virt.block_device [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Attempting to driver detach volume 894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 from mountpoint /dev/vdb
Nov 03 14:07:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Attempting to detach device vdb from instance 8f30eb65-1553-4f18-a861-b97e58dda769 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:07:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:07:56 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:07:56 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:07:56 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:07:56 user nova-compute[74582]:   <serial>894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5</serial>
Nov 03 14:07:56 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:07:56 user nova-compute[74582]: </disk>
Nov 03 14:07:56 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:07:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully detached device vdb from instance 8f30eb65-1553-4f18-a861-b97e58dda769 from the persistent domain config.
Nov 03 14:07:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f30eb65-1553-4f18-a861-b97e58dda769 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:07:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:07:56 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:07:56 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:07:56 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:07:56 user nova-compute[74582]:   <serial>894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5</serial>
Nov 03 14:07:56 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:07:56 user nova-compute[74582]: </disk>
Nov 03 14:07:56 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:07:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f30eb65-1553-4f18-a861-b97e58dda769 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:07:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:07:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:07:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:08:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b594495-ee96-4a48-a789-ab1d14135410 is timed out.
Nov 03 14:08:02 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully detached device vdb from instance 1b594495-ee96-4a48-a789-ab1d14135410 from the live domain config.
Nov 03 14:08:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgJYiPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:08:02 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd1838c-76e3-4e27-afb3-994534d9d875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:08:02 user nova-compute[74582]: No targets found.
Nov 03 14:08:02 user nova-compute[74582]: iSNS:
Nov 03 14:08:02 user nova-compute[74582]: No targets found.
Nov 03 14:08:02 user nova-compute[74582]: STATIC:
Nov 03 14:08:02 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b
Nov 03 14:08:02 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:08:02 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:08:02 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5
Nov 03 14:08:02 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:08:02 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:08:02 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f
Nov 03 14:08:02 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:08:02 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:08:02 user nova-compute[74582]: FIRMWARE:
Nov 03 14:08:02 user nova-compute[74582]: No targets found.
Nov 03 14:08:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:08:02 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:08:02 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca623ee4-182e-4685-ae00-2c86f8580cb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c3350-9931-4a82-b173-164814cf29b6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:08:02 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:08:02 user nova-compute[74582]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)
Nov 03 14:08:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f (non-flash)
Nov 03 14:08:02 user nova-compute[74582]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:08:02 user nova-compute[74582]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)
Nov 03 14:08:02 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f6861b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e472572-9b5c-48b0-bafb-6437cde5383d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06827910-f044-42da-b7de-469a90c58831]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5576155a-dcaa-463b-b509-835184ad3b78]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[929c8458-0332-402b-a5fb-612fd4ae0883]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24bafb3-4c4e-45ff-a151-ad585aa518f8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5012a6fc-70a7-499e-ba4a-ae44e84f50ae]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260]
Nov 03 14:08:03 user nova-compute[74582]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f, portal: 172.16.0.220,3260] successful.
Nov 03 14:08:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b56d2602-8e5e-423c-96f5-5891b71c153f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c1afd5-b8b5-43cc-93b8-848460723c13]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== disconnect_volume: return (293ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:08:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:08:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'flavor' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-72318d4f-9403-433a-a9ae-57368c3a8c0a tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.287s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:08:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:08:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [{"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-1b594495-ee96-4a48-a789-ab1d14135410" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:08:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:12 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:13 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=25.236465454101562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1b594495-ee96-4a48-a789-ab1d14135410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ce4dda5c-bd2b-4bce-9def-e076b5b2106a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 339e891c-da3f-46a3-8303-0d88bb770627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:08:14 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:08:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.039s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:08:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:17 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f30eb65-1553-4f18-a861-b97e58dda769 is timed out.
Nov 03 14:08:17 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully detached device vdb from instance 8f30eb65-1553-4f18-a861-b97e58dda769 from the live domain config.
Nov 03 14:08:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZmfkKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:08:17 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1854565-f3d9-45ea-9125-922f611994e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:08:17 user nova-compute[74582]: No targets found.
Nov 03 14:08:17 user nova-compute[74582]: iSNS:
Nov 03 14:08:17 user nova-compute[74582]: No targets found.
Nov 03 14:08:17 user nova-compute[74582]: STATIC:
Nov 03 14:08:17 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b
Nov 03 14:08:17 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:08:17 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:08:17 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5
Nov 03 14:08:17 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:08:17 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:08:17 user nova-compute[74582]: FIRMWARE:
Nov 03 14:08:17 user nova-compute[74582]: No targets found.
Nov 03 14:08:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:08:17 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:08:17 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a3e69-7ba0-45a7-aff1-5b35dcee677b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2036af-9ca7-46f6-be35-34083bec6705]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:08:17 user nova-compute[74582]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)
Nov 03 14:08:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:08:17 user nova-compute[74582]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 (non-flash)
Nov 03 14:08:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f684067a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2b52f-e2db-49dd-a4bf-89bd0486f13f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cce15cc-f27a-446c-8aa9-dd01eb1dd28c]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc22d9c-979a-453c-b354-66dab696fcee]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e11f74-2f8d-4f03-b257-7b4e7d5f2112]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe6ea2a-3ba2-40c6-a401-0c19feaed5a7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4338b-90ac-4586-9cb7-12572fa9f2ae]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260]
Nov 03 14:08:17 user nova-compute[74582]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5, portal: 172.16.0.220,3260] successful.
Nov 03 14:08:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894b0bf9-6af0-45c2-a3a9-c1e0bbbe7cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee2e6ab-839c-4f07-968e-3946a48513c7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] <== disconnect_volume: return (315ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "0275356d-d813-4902-bdbf-ab7914981c59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:08:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:08:18 user nova-compute[74582]: INFO nova.compute.claims [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Claim successful on node user
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.objects.instance [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'flavor' on Instance uuid 8f30eb65-1553-4f18-a861-b97e58dda769 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-70a31e1b-1009-4cb6-8bae-28be321f0c49 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.091s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.439s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:08:18 user nova-compute[74582]: INFO nova.compute.claims [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Claim successful on node user
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:08:18 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:08:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.policy [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21a795451e044a8394ff26ca920c44f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72750b673ec946e08a94d8691bfc8e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:08:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Creating image(s)
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "/opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "/opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "/opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.848s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:08:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk 1073741824" returned: 0 in 0.071s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.policy [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac294094d1a04b5bb8bb411fd2f01abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcde03473d540bf8c8ea8c0828d2f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:08:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Creating image(s)
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "/opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "/opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "/opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Successfully created port: a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.207s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Cannot resize image /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Ensure instance console log exists: /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk 1073741824" returned: 0 in 0.053s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Successfully created port: 038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.246s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Successfully updated port: a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquired lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-changed-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Refreshing instance network info cache due to event network-changed-a3ebab0e-13b2-43cb-add3-96b240db4ea0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] Acquiring lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Cannot resize image /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Ensure instance console log exists: /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updating instance_info_cache with network_info: [{"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Releasing lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Instance network_info: |[{"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] Acquired lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.neutron [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Refreshing network info cache for port a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Start _get_guest_xml network_info=[{"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:08:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-848214492',display_name='tempest-VolumesSnapshotTestJSON-instance-848214492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-848214492',id=35,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAdgwh30ermBgOVSC6oy1cKx9wunXR1K/kJxG4gNhlyf/X5XOreP1kqDk8FDHcZbFDolw70u4uBAyQvBpB1qkIMmD84gRmFz6FDu2MhQR8BezAUGjvDwwIcLhW7XZ16fw==',key_name='tempest-keypair-1161947357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72750b673ec946e08a94d8691bfc8e83',ramdisk_id='',reservation_id='r-lfh7sf0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2065237936',owner_user_name='tempest-VolumesSnapshotTestJSON-2065237936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21a795451e044a8394ff26ca920c44f1',uuid=b29d365d-6c44-426c-9103-e4526f1805cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converting VIF {"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'pci_devices' on Instance uuid b29d365d-6c44-426c-9103-e4526f1805cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:08:20 user nova-compute[74582]:   <uuid>b29d365d-6c44-426c-9103-e4526f1805cd</uuid>
Nov 03 14:08:20 user nova-compute[74582]:   <name>instance-00000023</name>
Nov 03 14:08:20 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:08:20 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:08:20 user nova-compute[74582]:   <metadata>
Nov 03 14:08:20 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:08:20 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:08:20 user nova-compute[74582]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-848214492</nova:name>
Nov 03 14:08:20 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:08:20</nova:creationTime>
Nov 03 14:08:20 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:08:20 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:08:20 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:08:20 user nova-compute[74582]:       <nova:owner>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:user uuid="21a795451e044a8394ff26ca920c44f1">tempest-VolumesSnapshotTestJSON-2065237936-project-member</nova:user>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:project uuid="72750b673ec946e08a94d8691bfc8e83">tempest-VolumesSnapshotTestJSON-2065237936</nova:project>
Nov 03 14:08:20 user nova-compute[74582]:       </nova:owner>
Nov 03 14:08:20 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:08:20 user nova-compute[74582]:       <nova:ports>
Nov 03 14:08:20 user nova-compute[74582]:         <nova:port uuid="a3ebab0e-13b2-43cb-add3-96b240db4ea0">
Nov 03 14:08:20 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 14:08:20 user nova-compute[74582]:         </nova:port>
Nov 03 14:08:20 user nova-compute[74582]:       </nova:ports>
Nov 03 14:08:20 user nova-compute[74582]:     </nova:instance>
Nov 03 14:08:20 user nova-compute[74582]:   </metadata>
Nov 03 14:08:20 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:08:20 user nova-compute[74582]:     <system>
Nov 03 14:08:20 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:08:20 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:08:20 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:08:20 user nova-compute[74582]:       <entry name="serial">b29d365d-6c44-426c-9103-e4526f1805cd</entry>
Nov 03 14:08:20 user nova-compute[74582]:       <entry name="uuid">b29d365d-6c44-426c-9103-e4526f1805cd</entry>
Nov 03 14:08:20 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:08:20 user nova-compute[74582]:     </system>
Nov 03 14:08:20 user nova-compute[74582]:   </sysinfo>
Nov 03 14:08:20 user nova-compute[74582]:   <os>
Nov 03 14:08:20 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:08:20 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:08:20 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:08:20 user nova-compute[74582]:   </os>
Nov 03 14:08:20 user nova-compute[74582]:   <features>
Nov 03 14:08:20 user nova-compute[74582]:     <acpi/>
Nov 03 14:08:20 user nova-compute[74582]:     <apic/>
Nov 03 14:08:20 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:08:20 user nova-compute[74582]:   </features>
Nov 03 14:08:20 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:08:20 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:08:20 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:08:20 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:08:20 user nova-compute[74582]:   </clock>
Nov 03 14:08:20 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:08:20 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:08:20 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:08:20 user nova-compute[74582]:   </cpu>
Nov 03 14:08:20 user nova-compute[74582]:   <devices>
Nov 03 14:08:20 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:08:20 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:08:20 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk"/>
Nov 03 14:08:20 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:08:20 user nova-compute[74582]:     </disk>
Nov 03 14:08:20 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:08:20 user nova-compute[74582]:       <mac address="fa:16:3e:48:64:fe"/>
Nov 03 14:08:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:08:20 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:08:20 user nova-compute[74582]:       <target dev="tapa3ebab0e-13"/>
Nov 03 14:08:20 user nova-compute[74582]:     </interface>
Nov 03 14:08:20 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:08:20 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/console.log" append="off"/>
Nov 03 14:08:20 user nova-compute[74582]:     </serial>
Nov 03 14:08:20 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:08:20 user nova-compute[74582]:     <video>
Nov 03 14:08:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:08:20 user nova-compute[74582]:     </video>
Nov 03 14:08:20 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:08:20 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:08:20 user nova-compute[74582]:     </rng>
Nov 03 14:08:20 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:08:20 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:08:20 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:08:20 user nova-compute[74582]:     </memballoon>
Nov 03 14:08:20 user nova-compute[74582]:   </devices>
Nov 03 14:08:20 user nova-compute[74582]: </domain>
Nov 03 14:08:20 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-848214492',display_name='tempest-VolumesSnapshotTestJSON-instance-848214492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-848214492',id=35,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAdgwh30ermBgOVSC6oy1cKx9wunXR1K/kJxG4gNhlyf/X5XOreP1kqDk8FDHcZbFDolw70u4uBAyQvBpB1qkIMmD84gRmFz6FDu2MhQR8BezAUGjvDwwIcLhW7XZ16fw==',key_name='tempest-keypair-1161947357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72750b673ec946e08a94d8691bfc8e83',ramdisk_id='',reservation_id='r-lfh7sf0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2065237936',owner_user_name='tempest-VolumesSnapshotTestJSON-2065237936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21a795451e044a8394ff26ca920c44f1',uuid=b29d365d-6c44-426c-9103-e4526f1805cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converting VIF {"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG os_vif [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8102b43-7136-57b8-9d5b-a4c3a2771444', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3ebab0e-13, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3ebab0e-13, col_values=(('qos', UUID('d47caafd-3f74-4034-8ef1-12c1e4476817')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3ebab0e-13, col_values=(('external_ids', {'iface-id': 'a3ebab0e-13b2-43cb-add3-96b240db4ea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:64:fe', 'vm-uuid': 'b29d365d-6c44-426c-9103-e4526f1805cd'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: INFO os_vif [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13')
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No VIF found with MAC fa:16:3e:48:64:fe, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Successfully updated port: 038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "refresh_cache-0275356d-d813-4902-bdbf-ab7914981c59" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquired lock "refresh_cache-0275356d-d813-4902-bdbf-ab7914981c59" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-changed-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Refreshing instance network info cache due to event network-changed-038c994a-a864-4dea-859a-1c45bb2ad3fc. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] Acquiring lock "refresh_cache-0275356d-d813-4902-bdbf-ab7914981c59" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updated VIF entry in instance network info cache for port a3ebab0e-13b2-43cb-add3-96b240db4ea0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updating instance_info_cache with network_info: [{"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-37b613eb-5652-4575-ab0a-e909db738463 req-49c68f41-12e3-4190-ab1d-e1c9142de72f service nova] Releasing lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Updating instance_info_cache with network_info: [{"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Releasing lock "refresh_cache-0275356d-d813-4902-bdbf-ab7914981c59" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Instance network_info: |[{"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] Acquired lock "refresh_cache-0275356d-d813-4902-bdbf-ab7914981c59" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Refreshing network info cache for port 038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Start _get_guest_xml network_info=[{"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:08:21 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:21 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1598617869',display_name='tempest-VolumesActionsTest-instance-1598617869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1598617869',id=34,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfcde03473d540bf8c8ea8c0828d2f5f',ramdisk_id='',reservation_id='r-1ndd670h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1616593314',owner_user_name='tempest-VolumesActionsTest-1616593314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:08:20Z,user_data=None,user_id='ac294094d1a04b5bb8bb411fd2f01abf',uuid=0275356d-d813-4902-bdbf-ab7914981c59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converting VIF {"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lazy-loading 'pci_devices' on Instance uuid 0275356d-d813-4902-bdbf-ab7914981c59 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:08:21 user nova-compute[74582]:   <uuid>0275356d-d813-4902-bdbf-ab7914981c59</uuid>
Nov 03 14:08:21 user nova-compute[74582]:   <name>instance-00000022</name>
Nov 03 14:08:21 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:08:21 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:08:21 user nova-compute[74582]:   <metadata>
Nov 03 14:08:21 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:08:21 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:08:21 user nova-compute[74582]:       <nova:name>tempest-VolumesActionsTest-instance-1598617869</nova:name>
Nov 03 14:08:21 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:08:21</nova:creationTime>
Nov 03 14:08:21 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:08:21 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:08:21 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:08:21 user nova-compute[74582]:       <nova:owner>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:user uuid="ac294094d1a04b5bb8bb411fd2f01abf">tempest-VolumesActionsTest-1616593314-project-member</nova:user>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:project uuid="bfcde03473d540bf8c8ea8c0828d2f5f">tempest-VolumesActionsTest-1616593314</nova:project>
Nov 03 14:08:21 user nova-compute[74582]:       </nova:owner>
Nov 03 14:08:21 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:08:21 user nova-compute[74582]:       <nova:ports>
Nov 03 14:08:21 user nova-compute[74582]:         <nova:port uuid="038c994a-a864-4dea-859a-1c45bb2ad3fc">
Nov 03 14:08:21 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 14:08:21 user nova-compute[74582]:         </nova:port>
Nov 03 14:08:21 user nova-compute[74582]:       </nova:ports>
Nov 03 14:08:21 user nova-compute[74582]:     </nova:instance>
Nov 03 14:08:21 user nova-compute[74582]:   </metadata>
Nov 03 14:08:21 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:08:21 user nova-compute[74582]:     <system>
Nov 03 14:08:21 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:08:21 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:08:21 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:08:21 user nova-compute[74582]:       <entry name="serial">0275356d-d813-4902-bdbf-ab7914981c59</entry>
Nov 03 14:08:21 user nova-compute[74582]:       <entry name="uuid">0275356d-d813-4902-bdbf-ab7914981c59</entry>
Nov 03 14:08:21 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:08:21 user nova-compute[74582]:     </system>
Nov 03 14:08:21 user nova-compute[74582]:   </sysinfo>
Nov 03 14:08:21 user nova-compute[74582]:   <os>
Nov 03 14:08:21 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:08:21 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:08:21 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:08:21 user nova-compute[74582]:   </os>
Nov 03 14:08:21 user nova-compute[74582]:   <features>
Nov 03 14:08:21 user nova-compute[74582]:     <acpi/>
Nov 03 14:08:21 user nova-compute[74582]:     <apic/>
Nov 03 14:08:21 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:08:21 user nova-compute[74582]:   </features>
Nov 03 14:08:21 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:08:21 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:08:21 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:08:21 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:08:21 user nova-compute[74582]:   </clock>
Nov 03 14:08:21 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:08:21 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:08:21 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:08:21 user nova-compute[74582]:   </cpu>
Nov 03 14:08:21 user nova-compute[74582]:   <devices>
Nov 03 14:08:21 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:08:21 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:08:21 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk"/>
Nov 03 14:08:21 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:08:21 user nova-compute[74582]:     </disk>
Nov 03 14:08:21 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:08:21 user nova-compute[74582]:       <mac address="fa:16:3e:69:90:4c"/>
Nov 03 14:08:21 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:08:21 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:08:21 user nova-compute[74582]:       <target dev="tap038c994a-a8"/>
Nov 03 14:08:21 user nova-compute[74582]:     </interface>
Nov 03 14:08:21 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:08:21 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/console.log" append="off"/>
Nov 03 14:08:21 user nova-compute[74582]:     </serial>
Nov 03 14:08:21 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:08:21 user nova-compute[74582]:     <video>
Nov 03 14:08:21 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:08:21 user nova-compute[74582]:     </video>
Nov 03 14:08:21 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:08:21 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:08:21 user nova-compute[74582]:     </rng>
Nov 03 14:08:21 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:08:21 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:08:21 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:08:21 user nova-compute[74582]:     </memballoon>
Nov 03 14:08:21 user nova-compute[74582]:   </devices>
Nov 03 14:08:21 user nova-compute[74582]: </domain>
Nov 03 14:08:21 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1598617869',display_name='tempest-VolumesActionsTest-instance-1598617869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1598617869',id=34,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfcde03473d540bf8c8ea8c0828d2f5f',ramdisk_id='',reservation_id='r-1ndd670h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1616593314',owner_user_name='tempest-VolumesActionsTest-1616593314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:08:20Z,user_data=None,user_id='ac294094d1a04b5bb8bb411fd2f01abf',uuid=0275356d-d813-4902-bdbf-ab7914981c59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converting VIF {"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG os_vif [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3857101-cc4c-5c6c-8583-bcc5a6222a8c', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038c994a-a8, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap038c994a-a8, col_values=(('qos', UUID('a30e36af-a1a4-4ab8-8c0c-bf35a090f84e')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap038c994a-a8, col_values=(('external_ids', {'iface-id': '038c994a-a864-4dea-859a-1c45bb2ad3fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:90:4c', 'vm-uuid': '0275356d-d813-4902-bdbf-ab7914981c59'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:21 user nova-compute[74582]: INFO os_vif [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8')
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] No VIF found with MAC fa:16:3e:69:90:4c, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Updated VIF entry in instance network info cache for port 038c994a-a864-4dea-859a-1c45bb2ad3fc. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Updating instance_info_cache with network_info: [{"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-773b6c4d-de94-4976-9757-4640d366d111 req-a4fdd6da-5cfd-4e49-8741-3e71f01aa5a5 service nova] Releasing lock "refresh_cache-0275356d-d813-4902-bdbf-ab7914981c59" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] No waiting events found dispatching network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:23 user nova-compute[74582]: WARNING nova.compute.manager [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received unexpected event network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 for instance with vm_state building and task_state spawning.
Nov 03 14:08:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] No waiting events found dispatching network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:23 user nova-compute[74582]: WARNING nova.compute.manager [req-ae493cc5-8ff5-4858-947c-c13b250314d0 req-1e059791-0ccb-4c81-a0df-8dd78dacbaa2 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received unexpected event network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 for instance with vm_state building and task_state spawning.
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] No waiting events found dispatching network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:25 user nova-compute[74582]: WARNING nova.compute.manager [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received unexpected event network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc for instance with vm_state building and task_state spawning.
Nov 03 14:08:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] No waiting events found dispatching network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:25 user nova-compute[74582]: WARNING nova.compute.manager [req-eac6b8a9-0f69-4e1a-80c3-42bb977e1524 req-ee915565-085c-42bf-a6b2-d76a606ad3de service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received unexpected event network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc for instance with vm_state building and task_state spawning.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:08:26 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Instance spawned successfully.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:08:26 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Instance spawned successfully.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:08:26 user nova-compute[74582]: INFO nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Took 7.23 seconds to spawn the instance on the hypervisor.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:08:26 user nova-compute[74582]: INFO nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:08:26 user nova-compute[74582]: INFO nova.compute.manager [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Took 8.39 seconds to build instance.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bb482385-0875-451c-8a9d-651370554556 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.493s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:26 user nova-compute[74582]: INFO nova.compute.manager [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Took 8.45 seconds to build instance.
Nov 03 14:08:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f08f922c-7445-48ca-97a2-7323486366bc tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "0275356d-d813-4902-bdbf-ab7914981c59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.567s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:08:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:08:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:08:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing instance network info cache due to event network-changed-b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] Acquiring lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] Acquired lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.network.neutron [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Refreshing network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:43 user nova-compute[74582]: INFO nova.compute.manager [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Terminating instance
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-9ac0fe10-6e55-4812-ac77-e49f71f307e3 req-fb0a2614-91b6-4bfd-bdb0-9e91cf9f053d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-unplugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9ac0fe10-6e55-4812-ac77-e49f71f307e3 req-fb0a2614-91b6-4bfd-bdb0-9e91cf9f053d service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9ac0fe10-6e55-4812-ac77-e49f71f307e3 req-fb0a2614-91b6-4bfd-bdb0-9e91cf9f053d service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9ac0fe10-6e55-4812-ac77-e49f71f307e3 req-fb0a2614-91b6-4bfd-bdb0-9e91cf9f053d service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-9ac0fe10-6e55-4812-ac77-e49f71f307e3 req-fb0a2614-91b6-4bfd-bdb0-9e91cf9f053d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-unplugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:43 user nova-compute[74582]: DEBUG nova.compute.manager [req-9ac0fe10-6e55-4812-ac77-e49f71f307e3 req-fb0a2614-91b6-4bfd-bdb0-9e91cf9f053d service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-unplugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updated VIF entry in instance network info cache for port b187fce7-d381-4707-8cc7-8b6497cdaacb. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [{"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-aa871c06-4cd0-43cb-8f49-b10270ddb841 req-affeb648-e1ee-4115-977e-cc91e046f01a service nova] Releasing lock "refresh_cache-ce4dda5c-bd2b-4bce-9def-e076b5b2106a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Instance destroyed successfully.
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.objects.instance [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lazy-loading 'resources' on Instance uuid ce4dda5c-bd2b-4bce-9def-e076b5b2106a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T14:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-232847620',display_name='tempest-TestShelveInstance-server-232847620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-232847620',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtMnTFblYCJsXQkmRLLKrlP9GSeiTmuxHzQtFofA2NymsPTQCbmZB/WPGMxwmEguhWqFjxcF7WBwINHWb0vnG/TROL/pZ491GaH3d5EtSQfiqUFM3yiRRYWvXqqn9EDpA==',key_name='tempest-TestShelveInstance-1970729209',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:07:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc9bce1e208f4b809df3cd71cccf1064',ramdisk_id='',reservation_id='r-mo0t1e8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159972837',owner_user_name='tempest-TestShelveInstance-1159972837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:07:21Z,user_data=None,user_id='1b40b982348e4a42be1953ce067bd977',uuid=ce4dda5c-bd2b-4bce-9def-e076b5b2106a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converting VIF {"id": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "address": "fa:16:3e:4d:0e:56", "network": {"id": "c7764069-212c-40c2-87ee-60a811385ff7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1303299895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9bce1e208f4b809df3cd71cccf1064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb187fce7-d3", "ovs_interfaceid": "b187fce7-d381-4707-8cc7-8b6497cdaacb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_vif [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb187fce7-d3, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce025b6c-3ac7-4c60-b556-c52dc0d3b8dc) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: INFO os_vif [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=b187fce7-d381-4707-8cc7-8b6497cdaacb,network=Network(c7764069-212c-40c2-87ee-60a811385ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb187fce7-d3')
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeDJzhFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:08:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a87da-a4d1-42a9-a670-b5f52d675d39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:08:44 user nova-compute[74582]: No targets found.
Nov 03 14:08:44 user nova-compute[74582]: iSNS:
Nov 03 14:08:44 user nova-compute[74582]: No targets found.
Nov 03 14:08:44 user nova-compute[74582]: STATIC:
Nov 03 14:08:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b
Nov 03 14:08:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:08:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:08:44 user nova-compute[74582]: FIRMWARE:
Nov 03 14:08:44 user nova-compute[74582]: No targets found.
Nov 03 14:08:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:08:44 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:08:44 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af246d1-0ca3-499b-9d49-58ff0b160355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6d059-9d5a-4aca-8ff8-2824834554cf]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:08:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b (non-flash)
Nov 03 14:08:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f8010dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a80fc8c-308c-46d0-81c6-a2b983be230b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b8c1c7-2fc8-4a0f-ada1-01ba5d5928e4]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e42a22f-4ac1-444f-8445-481d61e365f9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5afdbe5-3921-4045-8e53-b104c9c3526d]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26631623061383436', '/dev/disk/by-id/scsi-1SCST_BIO24fd3c39-f1b0a846ae357edd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_24fd3c39') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff8b31b-791c-4507-8172-98e5885198ba]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e26ae9-79bb-40b8-8be9-7d159515a665]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f066b4-c5ab-46b2-863d-ef9edd9d2643]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260]
Nov 03 14:08:44 user nova-compute[74582]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b, portal: 172.16.0.220,3260] successful.
Nov 03 14:08:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42fa1d41-757f-4698-9f7f-b08067eb655b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c2bd91-1173-47cc-965d-b611ba5ed04c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] <== disconnect_volume: return (311ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:08:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Deleting instance files /opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a_del
Nov 03 14:08:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Deletion of /opt/stack/data/nova/instances/ce4dda5c-bd2b-4bce-9def-e076b5b2106a_del complete
Nov 03 14:08:44 user nova-compute[74582]: INFO nova.compute.manager [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:44 user nova-compute[74582]: INFO nova.compute.manager [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Terminating instance
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-3413559c-4193-4a20-9041-16d3c1cbdc63 req-02789d59-deb5-4e60-8fa3-b5ed4a4512e2 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-unplugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3413559c-4193-4a20-9041-16d3c1cbdc63 req-02789d59-deb5-4e60-8fa3-b5ed4a4512e2 service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3413559c-4193-4a20-9041-16d3c1cbdc63 req-02789d59-deb5-4e60-8fa3-b5ed4a4512e2 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3413559c-4193-4a20-9041-16d3c1cbdc63 req-02789d59-deb5-4e60-8fa3-b5ed4a4512e2 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-3413559c-4193-4a20-9041-16d3c1cbdc63 req-02789d59-deb5-4e60-8fa3-b5ed4a4512e2 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-unplugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-3413559c-4193-4a20-9041-16d3c1cbdc63 req-02789d59-deb5-4e60-8fa3-b5ed4a4512e2 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-unplugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Took 0.57 seconds to deallocate network for instance.
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Instance destroyed successfully.
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'resources' on Instance uuid 1b594495-ee96-4a48-a789-ab1d14135410 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:02:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1687070852',display_name='tempest-TestMinimumBasicScenario-server-1687070852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1687070852',id=31,image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXbt00hUhVjJka/8XJWIzVA/aV0ZDnlyeHXSd9zVxLtEsVmvJmpu5TbVD9WHOvl4YjmUhDJkjW/pJ/hjS/mkQ6NMOTQMBndodmqcfHsMdXZDdKQ16w9ZdlHzeY0+2GcTw==',key_name='tempest-TestMinimumBasicScenario-97236426',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-g3b17wod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db79ffbd-73c1-4880-8895-06a5ba7cd25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:05:56Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=1b594495-ee96-4a48-a789-ab1d14135410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "address": "fa:16:3e:2f:e4:54", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5dbb6f-1c", "ovs_interfaceid": "eb5dbb6f-1cf8-4b3a-a747-275e16d52d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG os_vif [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb5dbb6f-1c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21ba1018-e952-47ff-ba26-87ffdbafa680) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:45 user nova-compute[74582]: INFO os_vif [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e4:54,bridge_name='br-int',has_traffic_filtering=True,id=eb5dbb6f-1cf8-4b3a-a747-275e16d52d75,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5dbb6f-1c')
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Deleting instance files /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410_del
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Deletion of /opt/stack/data/nova/instances/1b594495-ee96-4a48-a789-ab1d14135410_del complete
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.compute.manager [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 03 14:08:45 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-65a69003-e0ff-4c7b-b9b6-6dfdd277dddc req-9a087a19-7411-4636-8be8-da1b93f49694 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-65a69003-e0ff-4c7b-b9b6-6dfdd277dddc req-9a087a19-7411-4636-8be8-da1b93f49694 service nova] Acquiring lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-65a69003-e0ff-4c7b-b9b6-6dfdd277dddc req-9a087a19-7411-4636-8be8-da1b93f49694 service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-65a69003-e0ff-4c7b-b9b6-6dfdd277dddc req-9a087a19-7411-4636-8be8-da1b93f49694 service nova] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-65a69003-e0ff-4c7b-b9b6-6dfdd277dddc req-9a087a19-7411-4636-8be8-da1b93f49694 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] No waiting events found dispatching network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:45 user nova-compute[74582]: WARNING nova.compute.manager [req-65a69003-e0ff-4c7b-b9b6-6dfdd277dddc req-9a087a19-7411-4636-8be8-da1b93f49694 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received unexpected event network-vif-plugged-b187fce7-d381-4707-8cc7-8b6497cdaacb for instance with vm_state active and task_state deleting.
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Took 0.48 seconds to deallocate network for instance.
Nov 03 14:08:45 user nova-compute[74582]: INFO nova.compute.manager [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Took 0.89 seconds to detach 1 volumes for instance.
Nov 03 14:08:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Deleting volume: 42fa1d41-757f-4698-9f7f-b08067eb655b {{(pid=74582) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.243s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:46 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Deleted allocations for instance 1b594495-ee96-4a48-a789-ab1d14135410
Nov 03 14:08:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7a456f95-24e4-4486-b5ab-e04ba4719e3f tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "1b594495-ee96-4a48-a789-ab1d14135410" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:46 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Deleted allocations for instance ce4dda5c-bd2b-4bce-9def-e076b5b2106a
Nov 03 14:08:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c47bf3-b479-4c69-bd98-d6dfd201cd96 tempest-TestShelveInstance-1159972837 tempest-TestShelveInstance-1159972837-project-member] Lock "ce4dda5c-bd2b-4bce-9def-e076b5b2106a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.524s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] [instance: ce4dda5c-bd2b-4bce-9def-e076b5b2106a] Received event network-vif-deleted-b187fce7-d381-4707-8cc7-8b6497cdaacb {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] Acquiring lock "1b594495-ee96-4a48-a789-ab1d14135410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] Lock "1b594495-ee96-4a48-a789-ab1d14135410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] No waiting events found dispatching network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:47 user nova-compute[74582]: WARNING nova.compute.manager [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received unexpected event network-vif-plugged-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 for instance with vm_state deleted and task_state None.
Nov 03 14:08:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-b3fa6750-596a-44db-8d74-ebf50342acff req-4849a147-61d2-4eb1-85d7-315d63a6db80 service nova] [instance: 1b594495-ee96-4a48-a789-ab1d14135410] Received event network-vif-deleted-eb5dbb6f-1cf8-4b3a-a747-275e16d52d75 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:53 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:08:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:53 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:08:53 user nova-compute[74582]: INFO nova.compute.claims [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Claim successful on node user
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:08:54 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.policy [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06455365cee44bea82e923ffb923b23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d445081fe9645b0961089dfa2c9ca85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:08:54 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Creating image(s)
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.257s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk 1073741824" returned: 0 in 0.071s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.261s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Successfully created port: 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Cannot resize image /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Ensure instance console log exists: /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Successfully updated port: 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing instance network info cache due to event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance network_info: |[{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Start _get_guest_xml network_info=[{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:08:56 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:56 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2073427584',display_name='tempest-ServerStableDeviceRescueTest-server-2073427584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2073427584',id=36,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLhMeU162JG7Wng8TnrmOxRS8FG4U7S7wLMbRvIFxpbtkI/cevU3/s+YwrSS1eY4canYYaWf88nqSBbhPKZQhuHHZdBZcG+zEyHX2KORDFjb/M0IiTJF54s987Tn3lRWA==',key_name='tempest-keypair-984564094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d445081fe9645b0961089dfa2c9ca85',ramdisk_id='',reservation_id='r-wp79qwwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1359208006',owner_user_name='tempest-ServerStableDeviceRescueTest-1359208006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06455365cee44bea82e923ffb923b23f',uuid=d62d7210-0ba4-4224-887b-ec3266072bb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converting VIF {"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.objects.instance [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'pci_devices' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:08:56 user nova-compute[74582]:   <uuid>d62d7210-0ba4-4224-887b-ec3266072bb0</uuid>
Nov 03 14:08:56 user nova-compute[74582]:   <name>instance-00000024</name>
Nov 03 14:08:56 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:08:56 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:08:56 user nova-compute[74582]:   <metadata>
Nov 03 14:08:56 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:08:56 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:08:56 user nova-compute[74582]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2073427584</nova:name>
Nov 03 14:08:56 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:08:56</nova:creationTime>
Nov 03 14:08:56 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:08:56 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:08:56 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:08:56 user nova-compute[74582]:       <nova:owner>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:user uuid="06455365cee44bea82e923ffb923b23f">tempest-ServerStableDeviceRescueTest-1359208006-project-member</nova:user>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:project uuid="0d445081fe9645b0961089dfa2c9ca85">tempest-ServerStableDeviceRescueTest-1359208006</nova:project>
Nov 03 14:08:56 user nova-compute[74582]:       </nova:owner>
Nov 03 14:08:56 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:08:56 user nova-compute[74582]:       <nova:ports>
Nov 03 14:08:56 user nova-compute[74582]:         <nova:port uuid="3673527d-6ca0-48b6-b6ee-b8ab9f4270c4">
Nov 03 14:08:56 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 14:08:56 user nova-compute[74582]:         </nova:port>
Nov 03 14:08:56 user nova-compute[74582]:       </nova:ports>
Nov 03 14:08:56 user nova-compute[74582]:     </nova:instance>
Nov 03 14:08:56 user nova-compute[74582]:   </metadata>
Nov 03 14:08:56 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:08:56 user nova-compute[74582]:     <system>
Nov 03 14:08:56 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:08:56 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:08:56 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:08:56 user nova-compute[74582]:       <entry name="serial">d62d7210-0ba4-4224-887b-ec3266072bb0</entry>
Nov 03 14:08:56 user nova-compute[74582]:       <entry name="uuid">d62d7210-0ba4-4224-887b-ec3266072bb0</entry>
Nov 03 14:08:56 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:08:56 user nova-compute[74582]:     </system>
Nov 03 14:08:56 user nova-compute[74582]:   </sysinfo>
Nov 03 14:08:56 user nova-compute[74582]:   <os>
Nov 03 14:08:56 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:08:56 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:08:56 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:08:56 user nova-compute[74582]:   </os>
Nov 03 14:08:56 user nova-compute[74582]:   <features>
Nov 03 14:08:56 user nova-compute[74582]:     <acpi/>
Nov 03 14:08:56 user nova-compute[74582]:     <apic/>
Nov 03 14:08:56 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:08:56 user nova-compute[74582]:   </features>
Nov 03 14:08:56 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:08:56 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:08:56 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:08:56 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:08:56 user nova-compute[74582]:   </clock>
Nov 03 14:08:56 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:08:56 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:08:56 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:08:56 user nova-compute[74582]:   </cpu>
Nov 03 14:08:56 user nova-compute[74582]:   <devices>
Nov 03 14:08:56 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:08:56 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:08:56 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk"/>
Nov 03 14:08:56 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:08:56 user nova-compute[74582]:     </disk>
Nov 03 14:08:56 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:08:56 user nova-compute[74582]:       <mac address="fa:16:3e:8f:20:d1"/>
Nov 03 14:08:56 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:08:56 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:08:56 user nova-compute[74582]:       <target dev="tap3673527d-6c"/>
Nov 03 14:08:56 user nova-compute[74582]:     </interface>
Nov 03 14:08:56 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:08:56 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/console.log" append="off"/>
Nov 03 14:08:56 user nova-compute[74582]:     </serial>
Nov 03 14:08:56 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:08:56 user nova-compute[74582]:     <video>
Nov 03 14:08:56 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:08:56 user nova-compute[74582]:     </video>
Nov 03 14:08:56 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:08:56 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:08:56 user nova-compute[74582]:     </rng>
Nov 03 14:08:56 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:08:56 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:08:56 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:08:56 user nova-compute[74582]:     </memballoon>
Nov 03 14:08:56 user nova-compute[74582]:   </devices>
Nov 03 14:08:56 user nova-compute[74582]: </domain>
Nov 03 14:08:56 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2073427584',display_name='tempest-ServerStableDeviceRescueTest-server-2073427584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2073427584',id=36,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLhMeU162JG7Wng8TnrmOxRS8FG4U7S7wLMbRvIFxpbtkI/cevU3/s+YwrSS1eY4canYYaWf88nqSBbhPKZQhuHHZdBZcG+zEyHX2KORDFjb/M0IiTJF54s987Tn3lRWA==',key_name='tempest-keypair-984564094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d445081fe9645b0961089dfa2c9ca85',ramdisk_id='',reservation_id='r-wp79qwwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1359208006',owner_user_name='tempest-ServerStableDeviceRescueTest-1359208006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06455365cee44bea82e923ffb923b23f',uuid=d62d7210-0ba4-4224-887b-ec3266072bb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converting VIF {"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG os_vif [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48a8fc12-88d5-5c10-aea4-793f2d8ec2c0', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3673527d-6c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3673527d-6c, col_values=(('qos', UUID('621d751a-d0da-471a-a4af-911e3f3917da')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3673527d-6c, col_values=(('external_ids', {'iface-id': '3673527d-6ca0-48b6-b6ee-b8ab9f4270c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:20:d1', 'vm-uuid': 'd62d7210-0ba4-4224-887b-ec3266072bb0'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:56 user nova-compute[74582]: INFO os_vif [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c')
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:08:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No VIF found with MAC fa:16:3e:8f:20:d1, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:08:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updated VIF entry in instance network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:08:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:08:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a108482f-dd0c-405f-9f46-11819d810f91 req-57df8aff-0671-4f15-93b2-fe8ad34fadf8 service nova] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-bf573a97-ef03-4b88-a514-30b596bef3e2 req-eb2c4a66-2d1e-4ead-94a2-176b630f9049 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bf573a97-ef03-4b88-a514-30b596bef3e2 req-eb2c4a66-2d1e-4ead-94a2-176b630f9049 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bf573a97-ef03-4b88-a514-30b596bef3e2 req-eb2c4a66-2d1e-4ead-94a2-176b630f9049 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bf573a97-ef03-4b88-a514-30b596bef3e2 req-eb2c4a66-2d1e-4ead-94a2-176b630f9049 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-bf573a97-ef03-4b88-a514-30b596bef3e2 req-eb2c4a66-2d1e-4ead-94a2-176b630f9049 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:08:58 user nova-compute[74582]: WARNING nova.compute.manager [req-bf573a97-ef03-4b88-a514-30b596bef3e2 req-eb2c4a66-2d1e-4ead-94a2-176b630f9049 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state building and task_state spawning.
Nov 03 14:08:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:08:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:09:00 user nova-compute[74582]: INFO nova.compute.manager [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] instance snapshotting
Nov 03 14:09:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Beginning live snapshot process
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:09:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance spawned successfully.
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-8d2c9fe6-6b14-4f16-aefb-36fdbe13c816 req-84d85c5c-c54d-4c52-9402-86b2a55d29f3 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8d2c9fe6-6b14-4f16-aefb-36fdbe13c816 req-84d85c5c-c54d-4c52-9402-86b2a55d29f3 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8d2c9fe6-6b14-4f16-aefb-36fdbe13c816 req-84d85c5c-c54d-4c52-9402-86b2a55d29f3 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8d2c9fe6-6b14-4f16-aefb-36fdbe13c816 req-84d85c5c-c54d-4c52-9402-86b2a55d29f3 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-8d2c9fe6-6b14-4f16-aefb-36fdbe13c816 req-84d85c5c-c54d-4c52-9402-86b2a55d29f3 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:09:00 user nova-compute[74582]: WARNING nova.compute.manager [req-8d2c9fe6-6b14-4f16-aefb-36fdbe13c816 req-84d85c5c-c54d-4c52-9402-86b2a55d29f3 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state building and task_state spawning.
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:00 user nova-compute[74582]: INFO nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 03 14:09:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:00 user nova-compute[74582]: INFO nova.compute.manager [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Took 7.22 seconds to build instance.
Nov 03 14:09:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-57066bd3-7c0b-4531-a483-19e970c619de tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.336s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz3e1yzwm/845dd86d3c7b4ca688608c4462795e07.delta 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz3e1yzwm/845dd86d3c7b4ca688608c4462795e07.delta 1073741824" returned: 0 in 0.064s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 14:09:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 14:09:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 14:09:02 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 14:09:02 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:09:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz3e1yzwm/845dd86d3c7b4ca688608c4462795e07.delta /opt/stack/data/nova/instances/snapshots/tmpz3e1yzwm/845dd86d3c7b4ca688608c4462795e07 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz3e1yzwm/845dd86d3c7b4ca688608c4462795e07.delta /opt/stack/data/nova/instances/snapshots/tmpz3e1yzwm/845dd86d3c7b4ca688608c4462795e07" returned: 0 in 0.568s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Snapshot extracted, beginning image upload
Nov 03 14:09:05 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Snapshot image upload complete
Nov 03 14:09:05 user nova-compute[74582]: INFO nova.compute.manager [None req-8e5c4442-532f-4393-a304-ce5c40214fe6 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Took 5.41 seconds to snapshot the instance on the hypervisor.
Nov 03 14:09:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:09:08 user nova-compute[74582]: INFO nova.compute.claims [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Claim successful on node user
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:09:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.policy [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db5774b6cb564ba98174b4cf04888359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a5c94d1094e269259d0b6037319aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:09:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Creating image(s)
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "/opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "/opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "11ed9668849f8eee4a71bc82f7f1eefd6ba90852" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "11ed9668849f8eee4a71bc82f7f1eefd6ba90852" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG nova.virt.images [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] 27e72d8e-a50f-47d2-8a15-77a91aac899c was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.part /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.part /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.converted" returned: 0 in 0.650s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Successfully created port: 40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "11ed9668849f8eee4a71bc82f7f1eefd6ba90852" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.100s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "11ed9668849f8eee4a71bc82f7f1eefd6ba90852" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "11ed9668849f8eee4a71bc82f7f1eefd6ba90852" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852,backing_fmt=raw /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852,backing_fmt=raw /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk 1073741824" returned: 0 in 0.059s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "11ed9668849f8eee4a71bc82f7f1eefd6ba90852" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Ensure instance console log exists: /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Successfully updated port: 40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquired lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-changed-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Refreshing instance network info cache due to event network-changed-40752499-34b9-442e-ae6d-6faf96238122. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] Acquiring lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-changed-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Refreshing instance network info cache due to event network-changed-fe6be05a-ae7a-4022-b40e-faba879bc06f. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] Acquiring lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] Acquired lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Refreshing network info cache for port fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating instance_info_cache with network_info: [{"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Releasing lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Instance network_info: |[{"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] Acquired lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:09:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Refreshing network info cache for port 40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Start _get_guest_xml network_info=[{"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='35fd462a2f90c2b41a186f79b3f65b4c',container_format='bare',created_at=2023-11-03T14:09:00Z,direct_url=<?>,disk_format='qcow2',id=27e72d8e-a50f-47d2-8a15-77a91aac899c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-725068827',owner='d77a5c94d1094e269259d0b6037319aa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T14:09:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '27e72d8e-a50f-47d2-8a15-77a91aac899c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:09:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:09:12 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='35fd462a2f90c2b41a186f79b3f65b4c',container_format='bare',created_at=2023-11-03T14:09:00Z,direct_url=<?>,disk_format='qcow2',id=27e72d8e-a50f-47d2-8a15-77a91aac899c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-725068827',owner='d77a5c94d1094e269259d0b6037319aa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T14:09:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2127551426',display_name='tempest-TestStampPattern-server-2127551426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2127551426',id=37,image_ref='27e72d8e-a50f-47d2-8a15-77a91aac899c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtb8RAC35Ay0NuOoY0sqUucIv1xSQ5rEt2guSpAdeXJNP1NDaO8I8qlX3itFFRV8dIepDCZk1yyH9FZ6lG5GcbOOfXTSmewWSLa+X/BsbXndkr4Ujjx09AOtfXavppNwg==',key_name='tempest-TestStampPattern-1127467608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a5c94d1094e269259d0b6037319aa',ramdisk_id='',reservation_id='r-c1wgxh0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8f30eb65-1553-4f18-a861-b97e58dda769',image_min_disk='1',image_min_ram='0',image_owner_id='d77a5c94d1094e269259d0b6037319aa',image_owner_project_name='tempest-TestStampPattern-722996733',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-722996733-project-member',image_user_id='db5774b6cb564ba98174b4cf04888359',network_allocated='True',owner_project_name='tempest-TestStampPattern-722996733',owner_user_name='tempest-TestStampPattern-722996733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:09:09Z,user_data=None,user_id='db5774b6cb564ba98174b4cf04888359',uuid=d5982d99-655e-4036-a0b3-20e1974feca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converting VIF {"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.objects.instance [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'pci_devices' on Instance uuid d5982d99-655e-4036-a0b3-20e1974feca3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:09:12 user nova-compute[74582]:   <uuid>d5982d99-655e-4036-a0b3-20e1974feca3</uuid>
Nov 03 14:09:12 user nova-compute[74582]:   <name>instance-00000025</name>
Nov 03 14:09:12 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:09:12 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:09:12 user nova-compute[74582]:   <metadata>
Nov 03 14:09:12 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:09:12 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:09:12 user nova-compute[74582]:       <nova:name>tempest-TestStampPattern-server-2127551426</nova:name>
Nov 03 14:09:12 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:09:12</nova:creationTime>
Nov 03 14:09:12 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:09:12 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:09:12 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:09:12 user nova-compute[74582]:       <nova:owner>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:user uuid="db5774b6cb564ba98174b4cf04888359">tempest-TestStampPattern-722996733-project-member</nova:user>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:project uuid="d77a5c94d1094e269259d0b6037319aa">tempest-TestStampPattern-722996733</nova:project>
Nov 03 14:09:12 user nova-compute[74582]:       </nova:owner>
Nov 03 14:09:12 user nova-compute[74582]:       <nova:root type="image" uuid="27e72d8e-a50f-47d2-8a15-77a91aac899c"/>
Nov 03 14:09:12 user nova-compute[74582]:       <nova:ports>
Nov 03 14:09:12 user nova-compute[74582]:         <nova:port uuid="40752499-34b9-442e-ae6d-6faf96238122">
Nov 03 14:09:12 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 14:09:12 user nova-compute[74582]:         </nova:port>
Nov 03 14:09:12 user nova-compute[74582]:       </nova:ports>
Nov 03 14:09:12 user nova-compute[74582]:     </nova:instance>
Nov 03 14:09:12 user nova-compute[74582]:   </metadata>
Nov 03 14:09:12 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:09:12 user nova-compute[74582]:     <system>
Nov 03 14:09:12 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:09:12 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:09:12 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:09:12 user nova-compute[74582]:       <entry name="serial">d5982d99-655e-4036-a0b3-20e1974feca3</entry>
Nov 03 14:09:12 user nova-compute[74582]:       <entry name="uuid">d5982d99-655e-4036-a0b3-20e1974feca3</entry>
Nov 03 14:09:12 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:09:12 user nova-compute[74582]:     </system>
Nov 03 14:09:12 user nova-compute[74582]:   </sysinfo>
Nov 03 14:09:12 user nova-compute[74582]:   <os>
Nov 03 14:09:12 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:09:12 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:09:12 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:09:12 user nova-compute[74582]:   </os>
Nov 03 14:09:12 user nova-compute[74582]:   <features>
Nov 03 14:09:12 user nova-compute[74582]:     <acpi/>
Nov 03 14:09:12 user nova-compute[74582]:     <apic/>
Nov 03 14:09:12 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:09:12 user nova-compute[74582]:   </features>
Nov 03 14:09:12 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:09:12 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:09:12 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:09:12 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:09:12 user nova-compute[74582]:   </clock>
Nov 03 14:09:12 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:09:12 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:09:12 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:09:12 user nova-compute[74582]:   </cpu>
Nov 03 14:09:12 user nova-compute[74582]:   <devices>
Nov 03 14:09:12 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:09:12 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:09:12 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk"/>
Nov 03 14:09:12 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:09:12 user nova-compute[74582]:     </disk>
Nov 03 14:09:12 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:09:12 user nova-compute[74582]:       <mac address="fa:16:3e:e4:c5:a7"/>
Nov 03 14:09:12 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:09:12 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:09:12 user nova-compute[74582]:       <target dev="tap40752499-34"/>
Nov 03 14:09:12 user nova-compute[74582]:     </interface>
Nov 03 14:09:12 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:09:12 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/console.log" append="off"/>
Nov 03 14:09:12 user nova-compute[74582]:     </serial>
Nov 03 14:09:12 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:09:12 user nova-compute[74582]:     <video>
Nov 03 14:09:12 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:09:12 user nova-compute[74582]:     </video>
Nov 03 14:09:12 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:09:12 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:09:12 user nova-compute[74582]:     </rng>
Nov 03 14:09:12 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:09:12 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:09:12 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:09:12 user nova-compute[74582]:     </memballoon>
Nov 03 14:09:12 user nova-compute[74582]:   </devices>
Nov 03 14:09:12 user nova-compute[74582]: </domain>
Nov 03 14:09:12 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2127551426',display_name='tempest-TestStampPattern-server-2127551426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2127551426',id=37,image_ref='27e72d8e-a50f-47d2-8a15-77a91aac899c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtb8RAC35Ay0NuOoY0sqUucIv1xSQ5rEt2guSpAdeXJNP1NDaO8I8qlX3itFFRV8dIepDCZk1yyH9FZ6lG5GcbOOfXTSmewWSLa+X/BsbXndkr4Ujjx09AOtfXavppNwg==',key_name='tempest-TestStampPattern-1127467608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a5c94d1094e269259d0b6037319aa',ramdisk_id='',reservation_id='r-c1wgxh0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8f30eb65-1553-4f18-a861-b97e58dda769',image_min_disk='1',image_min_ram='0',image_owner_id='d77a5c94d1094e269259d0b6037319aa',image_owner_project_name='tempest-TestStampPattern-722996733',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-722996733-project-member',image_user_id='db5774b6cb564ba98174b4cf04888359',network_allocated='True',owner_project_name='tempest-TestStampPattern-722996733',owner_user_name='tempest-TestStampPattern-722996733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:09:09Z,user_data=None,user_id='db5774b6cb564ba98174b4cf04888359',uuid=d5982d99-655e-4036-a0b3-20e1974feca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converting VIF {"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG os_vif [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a93fbdd5-e892-5fd1-a434-d7e60b9790a8', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40752499-34, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40752499-34, col_values=(('qos', UUID('a2bebe26-de92-48a5-8bad-12f051c341dc')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40752499-34, col_values=(('external_ids', {'iface-id': '40752499-34b9-442e-ae6d-6faf96238122', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:c5:a7', 'vm-uuid': 'd5982d99-655e-4036-a0b3-20e1974feca3'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:12 user nova-compute[74582]: INFO os_vif [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34')
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No VIF found with MAC fa:16:3e:e4:c5:a7, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updated VIF entry in instance network info cache for port fe6be05a-ae7a-4022-b40e-faba879bc06f. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating instance_info_cache with network_info: [{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cc24f61e-fbc0-48a1-ae62-995964e65a43 req-cf80beee-21e7-4db4-9843-df3f22faa232 service nova] Releasing lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updated VIF entry in instance network info cache for port 40752499-34b9-442e-ae6d-6faf96238122. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG nova.network.neutron [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating instance_info_cache with network_info: [{"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:09:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9a0432d8-f2cf-4e0f-a2f4-caf307a9d3a8 req-0865ec0c-605f-4f97-9f14-ea3277bb400e service nova] Releasing lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-18cec1f9-8c3d-454a-9e6f-0350035d4931 req-ad73d6ec-4e54-4aa7-b7ae-3fa156641084 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-18cec1f9-8c3d-454a-9e6f-0350035d4931 req-ad73d6ec-4e54-4aa7-b7ae-3fa156641084 service nova] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-18cec1f9-8c3d-454a-9e6f-0350035d4931 req-ad73d6ec-4e54-4aa7-b7ae-3fa156641084 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-18cec1f9-8c3d-454a-9e6f-0350035d4931 req-ad73d6ec-4e54-4aa7-b7ae-3fa156641084 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-18cec1f9-8c3d-454a-9e6f-0350035d4931 req-ad73d6ec-4e54-4aa7-b7ae-3fa156641084 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] No waiting events found dispatching network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:09:13 user nova-compute[74582]: WARNING nova.compute.manager [req-18cec1f9-8c3d-454a-9e6f-0350035d4931 req-ad73d6ec-4e54-4aa7-b7ae-3fa156641084 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received unexpected event network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 for instance with vm_state building and task_state spawning.
Nov 03 14:09:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:09:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Instance spawned successfully.
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-f18221c3-5d74-4750-bd50-31d51af9686e req-8030625e-c86a-4bf3-b33e-a960beba6ba7 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f18221c3-5d74-4750-bd50-31d51af9686e req-8030625e-c86a-4bf3-b33e-a960beba6ba7 service nova] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f18221c3-5d74-4750-bd50-31d51af9686e req-8030625e-c86a-4bf3-b33e-a960beba6ba7 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f18221c3-5d74-4750-bd50-31d51af9686e req-8030625e-c86a-4bf3-b33e-a960beba6ba7 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-f18221c3-5d74-4750-bd50-31d51af9686e req-8030625e-c86a-4bf3-b33e-a960beba6ba7 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] No waiting events found dispatching network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:09:15 user nova-compute[74582]: WARNING nova.compute.manager [req-f18221c3-5d74-4750-bd50-31d51af9686e req-8030625e-c86a-4bf3-b33e-a960beba6ba7 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received unexpected event network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 for instance with vm_state building and task_state spawning.
Nov 03 14:09:15 user nova-compute[74582]: INFO nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 03 14:09:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:09:16 user nova-compute[74582]: INFO nova.compute.manager [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Took 7.84 seconds to build instance.
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dc3fe08f-916a-4070-a9a3-b6e017f4fd2a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.941s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:17 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:09:17 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7973MB free_disk=25.058589935302734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 339e891c-da3f-46a3-8303-0d88bb770627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 0275356d-d813-4902-bdbf-ab7914981c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b29d365d-6c44-426c-9103-e4526f1805cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d5982d99-655e-4036-a0b3-20e1974feca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:09:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:09:39 user nova-compute[74582]: INFO nova.compute.claims [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Claim successful on node user
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:09:39 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:09:39 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG nova.policy [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd63da82cd28e43849a1c8d8572385bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9069ac678f934449beb0ae6adf96911e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:09:40 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Creating image(s)
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "/opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "/opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "/opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "cf2b39d7f4fa69524e54cc6cd785a9206297029f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "cf2b39d7f4fa69524e54cc6cd785a9206297029f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG nova.virt.images [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] 289b1642-2528-4adc-a967-7823945c1656 was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.part /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Successfully created port: 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.part /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.converted" returned: 0 in 0.243s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "cf2b39d7f4fa69524e54cc6cd785a9206297029f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.237s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "cf2b39d7f4fa69524e54cc6cd785a9206297029f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "cf2b39d7f4fa69524e54cc6cd785a9206297029f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Successfully updated port: 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG nova.compute.manager [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing instance network info cache due to event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f,backing_fmt=raw /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f,backing_fmt=raw /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk 1073741824" returned: 0 in 0.055s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "cf2b39d7f4fa69524e54cc6cd785a9206297029f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:09:41 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance network_info: |[{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Cannot resize image /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Ensure instance console log exists: /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Start _get_guest_xml network_info=[{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T14:09:36Z,direct_url=<?>,disk_format='qcow2',id=289b1642-2528-4adc-a967-7823945c1656,min_disk=0,min_ram=0,name='tempest-scenario-img--2119298292',owner='9069ac678f934449beb0ae6adf96911e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T14:09:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '289b1642-2528-4adc-a967-7823945c1656'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:09:42 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:09:42 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T14:09:36Z,direct_url=<?>,disk_format='qcow2',id=289b1642-2528-4adc-a967-7823945c1656,min_disk=0,min_ram=0,name='tempest-scenario-img--2119298292',owner='9069ac678f934449beb0ae6adf96911e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T14:09:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1466795447',display_name='tempest-TestMinimumBasicScenario-server-1466795447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1466795447',id=38,image_ref='289b1642-2528-4adc-a967-7823945c1656',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInA/cl55XiSIxj25mlIYcdOcTjxCm9mgBBBNZpwaMM6j1NRoHTzbQJiGI5IVP9BD8a+coK1jbX5ezUEcmnEGvruDtuMcjvhNsRVv9xiddRJZLK7ztgh10QCpy2HzQ6sAA==',key_name='tempest-TestMinimumBasicScenario-1647796206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-ybb4vbq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='289b1642-2528-4adc-a967-7823945c1656',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:09:40Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=50562940-704d-4c03-a99e-c1e94dc6559e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'pci_devices' on Instance uuid 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:09:42 user nova-compute[74582]:   <uuid>50562940-704d-4c03-a99e-c1e94dc6559e</uuid>
Nov 03 14:09:42 user nova-compute[74582]:   <name>instance-00000026</name>
Nov 03 14:09:42 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:09:42 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:09:42 user nova-compute[74582]:   <metadata>
Nov 03 14:09:42 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:09:42 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:09:42 user nova-compute[74582]:       <nova:name>tempest-TestMinimumBasicScenario-server-1466795447</nova:name>
Nov 03 14:09:42 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:09:42</nova:creationTime>
Nov 03 14:09:42 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:09:42 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:09:42 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:09:42 user nova-compute[74582]:       <nova:owner>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:user uuid="d63da82cd28e43849a1c8d8572385bf7">tempest-TestMinimumBasicScenario-1621292284-project-member</nova:user>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:project uuid="9069ac678f934449beb0ae6adf96911e">tempest-TestMinimumBasicScenario-1621292284</nova:project>
Nov 03 14:09:42 user nova-compute[74582]:       </nova:owner>
Nov 03 14:09:42 user nova-compute[74582]:       <nova:root type="image" uuid="289b1642-2528-4adc-a967-7823945c1656"/>
Nov 03 14:09:42 user nova-compute[74582]:       <nova:ports>
Nov 03 14:09:42 user nova-compute[74582]:         <nova:port uuid="00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa">
Nov 03 14:09:42 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 14:09:42 user nova-compute[74582]:         </nova:port>
Nov 03 14:09:42 user nova-compute[74582]:       </nova:ports>
Nov 03 14:09:42 user nova-compute[74582]:     </nova:instance>
Nov 03 14:09:42 user nova-compute[74582]:   </metadata>
Nov 03 14:09:42 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:09:42 user nova-compute[74582]:     <system>
Nov 03 14:09:42 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:09:42 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:09:42 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:09:42 user nova-compute[74582]:       <entry name="serial">50562940-704d-4c03-a99e-c1e94dc6559e</entry>
Nov 03 14:09:42 user nova-compute[74582]:       <entry name="uuid">50562940-704d-4c03-a99e-c1e94dc6559e</entry>
Nov 03 14:09:42 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:09:42 user nova-compute[74582]:     </system>
Nov 03 14:09:42 user nova-compute[74582]:   </sysinfo>
Nov 03 14:09:42 user nova-compute[74582]:   <os>
Nov 03 14:09:42 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:09:42 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:09:42 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:09:42 user nova-compute[74582]:   </os>
Nov 03 14:09:42 user nova-compute[74582]:   <features>
Nov 03 14:09:42 user nova-compute[74582]:     <acpi/>
Nov 03 14:09:42 user nova-compute[74582]:     <apic/>
Nov 03 14:09:42 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:09:42 user nova-compute[74582]:   </features>
Nov 03 14:09:42 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:09:42 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:09:42 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:09:42 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:09:42 user nova-compute[74582]:   </clock>
Nov 03 14:09:42 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:09:42 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:09:42 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:09:42 user nova-compute[74582]:   </cpu>
Nov 03 14:09:42 user nova-compute[74582]:   <devices>
Nov 03 14:09:42 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:09:42 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:09:42 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk"/>
Nov 03 14:09:42 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:09:42 user nova-compute[74582]:     </disk>
Nov 03 14:09:42 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:09:42 user nova-compute[74582]:       <mac address="fa:16:3e:df:26:a2"/>
Nov 03 14:09:42 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:09:42 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:09:42 user nova-compute[74582]:       <target dev="tap00c51aa8-2b"/>
Nov 03 14:09:42 user nova-compute[74582]:     </interface>
Nov 03 14:09:42 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:09:42 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/console.log" append="off"/>
Nov 03 14:09:42 user nova-compute[74582]:     </serial>
Nov 03 14:09:42 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:09:42 user nova-compute[74582]:     <video>
Nov 03 14:09:42 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:09:42 user nova-compute[74582]:     </video>
Nov 03 14:09:42 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:09:42 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:09:42 user nova-compute[74582]:     </rng>
Nov 03 14:09:42 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:09:42 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:09:42 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:09:42 user nova-compute[74582]:     </memballoon>
Nov 03 14:09:42 user nova-compute[74582]:   </devices>
Nov 03 14:09:42 user nova-compute[74582]: </domain>
Nov 03 14:09:42 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1466795447',display_name='tempest-TestMinimumBasicScenario-server-1466795447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1466795447',id=38,image_ref='289b1642-2528-4adc-a967-7823945c1656',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInA/cl55XiSIxj25mlIYcdOcTjxCm9mgBBBNZpwaMM6j1NRoHTzbQJiGI5IVP9BD8a+coK1jbX5ezUEcmnEGvruDtuMcjvhNsRVv9xiddRJZLK7ztgh10QCpy2HzQ6sAA==',key_name='tempest-TestMinimumBasicScenario-1647796206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-ybb4vbq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='289b1642-2528-4adc-a967-7823945c1656',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:09:40Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=50562940-704d-4c03-a99e-c1e94dc6559e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG os_vif [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '874fc981-c7c8-5d90-8151-ad27cc483a1a', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00c51aa8-2b, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00c51aa8-2b, col_values=(('qos', UUID('16487c07-7595-434d-9e4a-95dba0e93edc')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00c51aa8-2b, col_values=(('external_ids', {'iface-id': '00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:26:a2', 'vm-uuid': '50562940-704d-4c03-a99e-c1e94dc6559e'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:42 user nova-compute[74582]: INFO os_vif [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b')
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No VIF found with MAC fa:16:3e:df:26:a2, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updated VIF entry in instance network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG nova.network.neutron [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:09:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b1b6b543-2d01-475f-bb3e-2c5e81471e6f req-38a7ab75-9df2-4cae-b267-682264bc0580 service nova] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:09:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0cedfe2-145b-4183-bafc-80c794b6641e req-1dfb7ad9-998e-48e8-a23a-221d3744b5d1 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0cedfe2-145b-4183-bafc-80c794b6641e req-1dfb7ad9-998e-48e8-a23a-221d3744b5d1 service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0cedfe2-145b-4183-bafc-80c794b6641e req-1dfb7ad9-998e-48e8-a23a-221d3744b5d1 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0cedfe2-145b-4183-bafc-80c794b6641e req-1dfb7ad9-998e-48e8-a23a-221d3744b5d1 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0cedfe2-145b-4183-bafc-80c794b6641e req-1dfb7ad9-998e-48e8-a23a-221d3744b5d1 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:09:44 user nova-compute[74582]: WARNING nova.compute.manager [req-c0cedfe2-145b-4183-bafc-80c794b6641e req-1dfb7ad9-998e-48e8-a23a-221d3744b5d1 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state building and task_state spawning.
Nov 03 14:09:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:09:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance spawned successfully.
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:09:45 user nova-compute[74582]: INFO nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 03 14:09:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:09:45 user nova-compute[74582]: INFO nova.compute.manager [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Took 6.43 seconds to build instance.
Nov 03 14:09:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3df35615-bd11-4ba5-aad5-de9372637e72 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-66f32325-105c-491d-85f3-963cfafdf583 req-2ec69b02-5c0c-422c-8703-41ef0f14adab service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:09:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-66f32325-105c-491d-85f3-963cfafdf583 req-2ec69b02-5c0c-422c-8703-41ef0f14adab service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:09:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-66f32325-105c-491d-85f3-963cfafdf583 req-2ec69b02-5c0c-422c-8703-41ef0f14adab service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:09:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-66f32325-105c-491d-85f3-963cfafdf583 req-2ec69b02-5c0c-422c-8703-41ef0f14adab service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:09:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-66f32325-105c-491d-85f3-963cfafdf583 req-2ec69b02-5c0c-422c-8703-41ef0f14adab service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:09:46 user nova-compute[74582]: WARNING nova.compute.manager [req-66f32325-105c-491d-85f3-963cfafdf583 req-2ec69b02-5c0c-422c-8703-41ef0f14adab service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state active and task_state None.
Nov 03 14:09:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:09:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:02 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:10:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "0275356d-d813-4902-bdbf-ab7914981c59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:08 user nova-compute[74582]: INFO nova.compute.manager [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Terminating instance
Nov 03 14:10:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-dd52870e-487e-4a13-8f74-6b3b1b8392c0 req-4686782f-a4f6-4b94-98f3-a03fb2e972da service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-vif-unplugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dd52870e-487e-4a13-8f74-6b3b1b8392c0 req-4686782f-a4f6-4b94-98f3-a03fb2e972da service nova] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dd52870e-487e-4a13-8f74-6b3b1b8392c0 req-4686782f-a4f6-4b94-98f3-a03fb2e972da service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dd52870e-487e-4a13-8f74-6b3b1b8392c0 req-4686782f-a4f6-4b94-98f3-a03fb2e972da service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-dd52870e-487e-4a13-8f74-6b3b1b8392c0 req-4686782f-a4f6-4b94-98f3-a03fb2e972da service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] No waiting events found dispatching network-vif-unplugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:10:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-dd52870e-487e-4a13-8f74-6b3b1b8392c0 req-4686782f-a4f6-4b94-98f3-a03fb2e972da service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-vif-unplugged-038c994a-a864-4dea-859a-1c45bb2ad3fc for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Instance destroyed successfully.
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lazy-loading 'resources' on Instance uuid 0275356d-d813-4902-bdbf-ab7914981c59 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1598617869',display_name='tempest-VolumesActionsTest-instance-1598617869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1598617869',id=34,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:08:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfcde03473d540bf8c8ea8c0828d2f5f',ramdisk_id='',reservation_id='r-1ndd670h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1616593314',owner_user_name='tempest-VolumesActionsTest-1616593314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:08:26Z,user_data=None,user_id='ac294094d1a04b5bb8bb411fd2f01abf',uuid=0275356d-d813-4902-bdbf-ab7914981c59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converting VIF {"id": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "address": "fa:16:3e:69:90:4c", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038c994a-a8", "ovs_interfaceid": "038c994a-a864-4dea-859a-1c45bb2ad3fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_vif [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038c994a-a8, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a30e36af-a1a4-4ab8-8c0c-bf35a090f84e) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:09 user nova-compute[74582]: INFO os_vif [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:90:4c,bridge_name='br-int',has_traffic_filtering=True,id=038c994a-a864-4dea-859a-1c45bb2ad3fc,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038c994a-a8')
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Deleting instance files /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59_del
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Deletion of /opt/stack/data/nova/instances/0275356d-d813-4902-bdbf-ab7914981c59_del complete
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'flavor' on Instance uuid b29d365d-6c44-426c-9103-e4526f1805cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.compute.manager [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Ignoring supplied device name: /dev/vdb
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.compute.manager [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Attaching volume 46c95fe1-0909-41a4-b056-a1446f3b9f66 to /dev/vdb
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1848279-a11a-4ad8-b18a-330fbc1ccdd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac74c8-9eaf-4e0d-bafd-138e33fbd6cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfce4a9-58a1-4f24-9ce1-8028df5fdd1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ea3f47-68fb-4f44-b7e7-9b626ee0eed5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:10:09 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ebfcad-4eff-4200-8a31-bfae9abba35d]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG os_brick.utils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updating existing volume attachment record: 1d5883c3-faa2-43cb-af30-96eb7a64e2e3 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:10:09 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Took 0.51 seconds to deallocate network for instance.
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:10 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:10:10 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:10:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:10 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Deleted allocations for instance 0275356d-d813-4902-bdbf-ab7914981c59
Nov 03 14:10:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7e849f87-4f4d-4974-a301-c5c855ffc828 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "0275356d-d813-4902-bdbf-ab7914981c59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-changed-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Refreshing instance network info cache due to event network-changed-a3ebab0e-13b2-43cb-add3-96b240db4ea0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] Acquiring lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] Acquired lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Refreshing network info cache for port a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updated VIF entry in instance network info cache for port a3ebab0e-13b2-43cb-add3-96b240db4ea0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updating instance_info_cache with network_info: [{"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] Releasing lock "refresh_cache-b29d365d-6c44-426c-9103-e4526f1805cd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] Acquiring lock "0275356d-d813-4902-bdbf-ab7914981c59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] Lock "0275356d-d813-4902-bdbf-ab7914981c59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] No waiting events found dispatching network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:10:11 user nova-compute[74582]: WARNING nova.compute.manager [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received unexpected event network-vif-plugged-038c994a-a864-4dea-859a-1c45bb2ad3fc for instance with vm_state deleted and task_state None.
Nov 03 14:10:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-59227020-1db1-4bc6-9ced-97f54f53b828 req-1aeec133-ba27-4f18-bbd1-6bcd3df388ec service nova] [instance: 0275356d-d813-4902-bdbf-ab7914981c59] Received event network-vif-deleted-038c994a-a864-4dea-859a-1c45bb2ad3fc {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:10:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:17 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:10:17 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=24.997421264648438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 339e891c-da3f-46a3-8303-0d88bb770627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b29d365d-6c44-426c-9103-e4526f1805cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d5982d99-655e-4036-a0b3-20e1974feca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 50562940-704d-4c03-a99e-c1e94dc6559e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:10:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDGUlpNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:10:28 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:10:28 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:10:28 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01654f-bd71-4d2d-aabc-9a36eadea042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:10:28 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23eb8bd-c30c-4cfb-9ae6-52f6b96d2389]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66] added
Nov 03 14:10:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3df27d-967c-43d4-a78b-22a59e7b0dbb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddc3601-b575-49b7-a67d-b7f3e03e6c1c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDGUlpNP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDGUlpNP" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba421d59-ceb3-4e54-aedc-095a834fbc7a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iDGUlpNP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a08a7b-b1f4-45a0-aeae-861de182f0f9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e2363c-cd44-4339-944e-8a54405ca116]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 14:10:28 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 14:10:28 user nova-compute[74582]:  {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:10:28 user nova-compute[74582]: WARNING os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 14:10:28 user nova-compute[74582]: 
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a4ce9-0574-4fe4-b4e8-2d896359bd5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260]
Nov 03 14:10:28 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260] successful.
Nov 03 14:10:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcdffc3-e9f7-4d75-8dc8-a0e14cd7a6bc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f9f2e0-b961-4ce1-a719-d0b11ccc17ab]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:10:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:10:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e871b3-04ea-446c-9609-9340da4d383b]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:10:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDGUlpNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26538343066346436', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538343066346436', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG nova.objects.instance [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'flavor' on Instance uuid b29d365d-6c44-426c-9103-e4526f1805cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:10:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:10:29 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:10:29 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:10:29 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:10:29 user nova-compute[74582]:   <serial>46c95fe1-0909-41a4-b056-a1446f3b9f66</serial>
Nov 03 14:10:29 user nova-compute[74582]: </disk>
Nov 03 14:10:29 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:10:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:10:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:10:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No VIF found with MAC fa:16:3e:48:64:fe, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:10:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-08cdf0bf-0684-4ab9-97ed-6b2808f2946a tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.764s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:10:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:10:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:10:44 user nova-compute[74582]: DEBUG nova.compute.manager [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing instance network info cache due to event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:10:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:10:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:10:44 user nova-compute[74582]: DEBUG nova.network.neutron [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:10:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updated VIF entry in instance network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:10:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:10:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-445147a3-7bb9-49ee-b3e7-0870c6ccea13 req-8ce8106e-c87c-43d4-b767-f517b5161d3f service nova] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:10:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:10:45 user nova-compute[74582]: INFO nova.compute.manager [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] instance snapshotting
Nov 03 14:10:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Beginning live snapshot process
Nov 03 14:10:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json -f qcow2 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn81jngjc/17151c7d62be4321ac238e699c9bf6af.delta 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn81jngjc/17151c7d62be4321ac238e699c9bf6af.delta 1073741824" returned: 0 in 0.055s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:46 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 14:10:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 14:10:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74582) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 14:10:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 14:10:47 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:10:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn81jngjc/17151c7d62be4321ac238e699c9bf6af.delta /opt/stack/data/nova/instances/snapshots/tmpn81jngjc/17151c7d62be4321ac238e699c9bf6af {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:10:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn81jngjc/17151c7d62be4321ac238e699c9bf6af.delta /opt/stack/data/nova/instances/snapshots/tmpn81jngjc/17151c7d62be4321ac238e699c9bf6af" returned: 0 in 0.525s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:10:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Snapshot extracted, beginning image upload
Nov 03 14:10:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:50 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Snapshot image upload complete
Nov 03 14:10:50 user nova-compute[74582]: INFO nova.compute.manager [None req-826e7a5b-ddcc-4def-a571-48494bf40685 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Took 5.21 seconds to snapshot the instance on the hypervisor.
Nov 03 14:10:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-changed-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Refreshing instance network info cache due to event network-changed-40752499-34b9-442e-ae6d-6faf96238122. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] Acquiring lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] Acquired lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:10:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Refreshing network info cache for port 40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:11:00 user nova-compute[74582]: INFO nova.compute.claims [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Claim successful on node user
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'flavor' on Instance uuid d5982d99-655e-4036-a0b3-20e1974feca3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updated VIF entry in instance network info cache for port 40752499-34b9-442e-ae6d-6faf96238122. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating instance_info_cache with network_info: [{"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fe1f19c9-7e4c-43a5-84ca-b873962dd4e1 req-e7bafd02-4db4-4023-8b79-f456b1d4be07 service nova] Releasing lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:00 user nova-compute[74582]: INFO nova.compute.manager [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Attaching volume 9d2ebe90-1203-4db4-ae5b-386274818972 to /dev/vdb
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG os_brick.utils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0171fd-27e6-4078-8453-5ffc73c98687]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5ed0c9-7b3f-4105-bd55-98207eba6c97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9008ce2-71e0-49cc-921e-2e39e2b19e62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[514cbb27-e124-4224-8216-cda1e85bc24b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:00 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0914c-fc8f-46db-ae3f-a1b12f4b8a37]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG os_brick.utils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating existing volume attachment record: 4834953a-e8fd-40a8-bc89-53330e9e72d3 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:11:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.policy [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac294094d1a04b5bb8bb411fd2f01abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcde03473d540bf8c8ea8c0828d2f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:11:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Creating image(s)
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "/opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "/opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "/opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Successfully created port: a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.250s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk 1073741824" returned: 0 in 0.048s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.259s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Cannot resize image /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Ensure instance console log exists: /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Successfully updated port: a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "refresh_cache-bec6a7a3-3cf4-476a-901e-fa139908bb8d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquired lock "refresh_cache-bec6a7a3-3cf4-476a-901e-fa139908bb8d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-changed-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Refreshing instance network info cache due to event network-changed-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:11:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] Acquiring lock "refresh_cache-bec6a7a3-3cf4-476a-901e-fa139908bb8d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.neutron [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Updating instance_info_cache with network_info: [{"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Releasing lock "refresh_cache-bec6a7a3-3cf4-476a-901e-fa139908bb8d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Instance network_info: |[{"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] Acquired lock "refresh_cache-bec6a7a3-3cf4-476a-901e-fa139908bb8d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Refreshing network info cache for port a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Start _get_guest_xml network_info=[{"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:11:02 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-526082533',display_name='tempest-VolumesActionsTest-instance-526082533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-526082533',id=39,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfcde03473d540bf8c8ea8c0828d2f5f',ramdisk_id='',reservation_id='r-mh4or0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1616593314',owner_user_name='tempest-VolumesActionsTest-1616593314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:11:01Z,user_data=None,user_id='ac294094d1a04b5bb8bb411fd2f01abf',uuid=bec6a7a3-3cf4-476a-901e-fa139908bb8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converting VIF {"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lazy-loading 'pci_devices' on Instance uuid bec6a7a3-3cf4-476a-901e-fa139908bb8d {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:11:02 user nova-compute[74582]:   <uuid>bec6a7a3-3cf4-476a-901e-fa139908bb8d</uuid>
Nov 03 14:11:02 user nova-compute[74582]:   <name>instance-00000027</name>
Nov 03 14:11:02 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:11:02 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:11:02 user nova-compute[74582]:   <metadata>
Nov 03 14:11:02 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:11:02 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:11:02 user nova-compute[74582]:       <nova:name>tempest-VolumesActionsTest-instance-526082533</nova:name>
Nov 03 14:11:02 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:11:02</nova:creationTime>
Nov 03 14:11:02 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:11:02 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:11:02 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:11:02 user nova-compute[74582]:       <nova:owner>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:user uuid="ac294094d1a04b5bb8bb411fd2f01abf">tempest-VolumesActionsTest-1616593314-project-member</nova:user>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:project uuid="bfcde03473d540bf8c8ea8c0828d2f5f">tempest-VolumesActionsTest-1616593314</nova:project>
Nov 03 14:11:02 user nova-compute[74582]:       </nova:owner>
Nov 03 14:11:02 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:11:02 user nova-compute[74582]:       <nova:ports>
Nov 03 14:11:02 user nova-compute[74582]:         <nova:port uuid="a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c">
Nov 03 14:11:02 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 14:11:02 user nova-compute[74582]:         </nova:port>
Nov 03 14:11:02 user nova-compute[74582]:       </nova:ports>
Nov 03 14:11:02 user nova-compute[74582]:     </nova:instance>
Nov 03 14:11:02 user nova-compute[74582]:   </metadata>
Nov 03 14:11:02 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:11:02 user nova-compute[74582]:     <system>
Nov 03 14:11:02 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:11:02 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:11:02 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:11:02 user nova-compute[74582]:       <entry name="serial">bec6a7a3-3cf4-476a-901e-fa139908bb8d</entry>
Nov 03 14:11:02 user nova-compute[74582]:       <entry name="uuid">bec6a7a3-3cf4-476a-901e-fa139908bb8d</entry>
Nov 03 14:11:02 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:11:02 user nova-compute[74582]:     </system>
Nov 03 14:11:02 user nova-compute[74582]:   </sysinfo>
Nov 03 14:11:02 user nova-compute[74582]:   <os>
Nov 03 14:11:02 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:11:02 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:11:02 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:11:02 user nova-compute[74582]:   </os>
Nov 03 14:11:02 user nova-compute[74582]:   <features>
Nov 03 14:11:02 user nova-compute[74582]:     <acpi/>
Nov 03 14:11:02 user nova-compute[74582]:     <apic/>
Nov 03 14:11:02 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:11:02 user nova-compute[74582]:   </features>
Nov 03 14:11:02 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:11:02 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:11:02 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:11:02 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:11:02 user nova-compute[74582]:   </clock>
Nov 03 14:11:02 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:11:02 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:11:02 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:11:02 user nova-compute[74582]:   </cpu>
Nov 03 14:11:02 user nova-compute[74582]:   <devices>
Nov 03 14:11:02 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:11:02 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:11:02 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk"/>
Nov 03 14:11:02 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:11:02 user nova-compute[74582]:     </disk>
Nov 03 14:11:02 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:11:02 user nova-compute[74582]:       <mac address="fa:16:3e:25:66:64"/>
Nov 03 14:11:02 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:11:02 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:11:02 user nova-compute[74582]:       <target dev="tapa2bdb9c4-74"/>
Nov 03 14:11:02 user nova-compute[74582]:     </interface>
Nov 03 14:11:02 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:11:02 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/console.log" append="off"/>
Nov 03 14:11:02 user nova-compute[74582]:     </serial>
Nov 03 14:11:02 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:11:02 user nova-compute[74582]:     <video>
Nov 03 14:11:02 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:11:02 user nova-compute[74582]:     </video>
Nov 03 14:11:02 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:11:02 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:11:02 user nova-compute[74582]:     </rng>
Nov 03 14:11:02 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:11:02 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:11:02 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:11:02 user nova-compute[74582]:     </memballoon>
Nov 03 14:11:02 user nova-compute[74582]:   </devices>
Nov 03 14:11:02 user nova-compute[74582]: </domain>
Nov 03 14:11:02 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-526082533',display_name='tempest-VolumesActionsTest-instance-526082533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-526082533',id=39,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfcde03473d540bf8c8ea8c0828d2f5f',ramdisk_id='',reservation_id='r-mh4or0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1616593314',owner_user_name='tempest-VolumesActionsTest-1616593314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:11:01Z,user_data=None,user_id='ac294094d1a04b5bb8bb411fd2f01abf',uuid=bec6a7a3-3cf4-476a-901e-fa139908bb8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converting VIF {"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG os_vif [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffa04e46-5a37-5aa5-9bbb-14d50c8e2f1e', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2bdb9c4-74, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2bdb9c4-74, col_values=(('qos', UUID('0327daaf-93b9-4342-b692-9b6deee71a20')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2bdb9c4-74, col_values=(('external_ids', {'iface-id': 'a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:66:64', 'vm-uuid': 'bec6a7a3-3cf4-476a-901e-fa139908bb8d'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:02 user nova-compute[74582]: INFO os_vif [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74')
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] No VIF found with MAC fa:16:3e:25:66:64, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Updated VIF entry in instance network info cache for port a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Updating instance_info_cache with network_info: [{"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:11:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-af8c121c-e5f7-43a5-8f3e-0f6b230c0382 req-eab6bec0-e5ba-4b69-b390-59122b21fe8a service nova] Releasing lock "refresh_cache-bec6a7a3-3cf4-476a-901e-fa139908bb8d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:11:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-385e3350-5c28-43c7-94cf-e62f3ea8168c req-3de46a6b-fd98-4d94-89ff-1400322180ea service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:11:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-385e3350-5c28-43c7-94cf-e62f3ea8168c req-3de46a6b-fd98-4d94-89ff-1400322180ea service nova] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-385e3350-5c28-43c7-94cf-e62f3ea8168c req-3de46a6b-fd98-4d94-89ff-1400322180ea service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-385e3350-5c28-43c7-94cf-e62f3ea8168c req-3de46a6b-fd98-4d94-89ff-1400322180ea service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-385e3350-5c28-43c7-94cf-e62f3ea8168c req-3de46a6b-fd98-4d94-89ff-1400322180ea service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] No waiting events found dispatching network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:11:04 user nova-compute[74582]: WARNING nova.compute.manager [req-385e3350-5c28-43c7-94cf-e62f3ea8168c req-3de46a6b-fd98-4d94-89ff-1400322180ea service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received unexpected event network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c for instance with vm_state building and task_state spawning.
Nov 03 14:11:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:11:06 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Instance spawned successfully.
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-c6e36b67-cf42-4962-989b-11c35a3a8b07 req-47a94f16-64a0-4490-8ddf-c0db68be66ab service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c6e36b67-cf42-4962-989b-11c35a3a8b07 req-47a94f16-64a0-4490-8ddf-c0db68be66ab service nova] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c6e36b67-cf42-4962-989b-11c35a3a8b07 req-47a94f16-64a0-4490-8ddf-c0db68be66ab service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c6e36b67-cf42-4962-989b-11c35a3a8b07 req-47a94f16-64a0-4490-8ddf-c0db68be66ab service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-c6e36b67-cf42-4962-989b-11c35a3a8b07 req-47a94f16-64a0-4490-8ddf-c0db68be66ab service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] No waiting events found dispatching network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:11:06 user nova-compute[74582]: WARNING nova.compute.manager [req-c6e36b67-cf42-4962-989b-11c35a3a8b07 req-47a94f16-64a0-4490-8ddf-c0db68be66ab service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received unexpected event network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c for instance with vm_state building and task_state spawning.
Nov 03 14:11:06 user nova-compute[74582]: INFO nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 03 14:11:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:11:06 user nova-compute[74582]: INFO nova.compute.manager [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Took 6.09 seconds to build instance.
Nov 03 14:11:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ee80e7bc-fe3b-4787-98c7-752723e4f70e tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.186s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lazy-loading 'flavor' on Instance uuid 339e891c-da3f-46a3-8303-0d88bb770627 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:09 user nova-compute[74582]: INFO nova.compute.manager [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Attaching volume e6956d3d-a1ee-46be-9ed3-d21d39389443 to /dev/vdb
Nov 03 14:11:10 user nova-compute[74582]: DEBUG os_brick.utils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[619846e4-050e-4bdc-9cc4-2f6104644d75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f4cb9e-9250-476f-988e-761a511f6ea0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[331657a6-31d7-42f5-b91d-ca1f770e400e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c8beb6-41fc-4fba-ba4e-39b61462b3ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:10 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:11:10 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f8a13-57c8-4f29-a144-aa1dc1e8eb4b]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG os_brick.utils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:10 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating existing volume attachment record: fd9515d2-81d3-4099-9845-5227db2bc14c {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:11:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:11:13 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:11:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:19 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:11:19 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=7926MB free_disk=24.94546127319336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 339e891c-da3f-46a3-8303-0d88bb770627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b29d365d-6c44-426c-9103-e4526f1805cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d5982d99-655e-4036-a0b3-20e1974feca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 50562940-704d-4c03-a99e-c1e94dc6559e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bec6a7a3-3cf4-476a-901e-fa139908bb8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:11:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OksZvVhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:21 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:21 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:21 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5716061-742f-4702-bc09-eb14bf5fea87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:11:21 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e26b77-d11b-41d3-af11-90db127d5c60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972] added
Nov 03 14:11:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdeb3df-7779-4f5c-9764-d6dd1eea0be6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[38208531-7594-4876-a5eb-09b6cd606c1c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OksZvVhd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OksZvVhd" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1634ec55-d1f0-4797-be91-c9b510b7ee5f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OksZvVhd'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b568b-2416-429c-8511-46f979856de4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafcfde0-2732-4f2e-86a7-1271e2bccfba]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2829245-1417-47ce-8572-327f44119ea1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260]
Nov 03 14:11:21 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260] successful.
Nov 03 14:11:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c09074-4191-40b4-bf46-1aeab5e4cd5a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2936e-0fb0-4e86-a6e2-4aab15ed6ed9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:21 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:21 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:21 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c5b92-4f66-4411-b276-b10daac7f196]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:11:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OksZvVhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:11:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26632373264643133', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632373264643133', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:11:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'flavor' on Instance uuid d5982d99-655e-4036-a0b3-20e1974feca3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:11:22 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:22 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:11:22 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:22 user nova-compute[74582]:   <serial>9d2ebe90-1203-4db4-ae5b-386274818972</serial>
Nov 03 14:11:22 user nova-compute[74582]: </disk>
Nov 03 14:11:22 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:11:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] No VIF found with MAC fa:16:3e:e4:c5:a7, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:11:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c22407d-6155-42d5-9c3a-362caf8e815a tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.840s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:25 user nova-compute[74582]: INFO nova.compute.manager [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Detaching volume 9d2ebe90-1203-4db4-ae5b-386274818972
Nov 03 14:11:25 user nova-compute[74582]: INFO nova.virt.block_device [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Attempting to driver detach volume 9d2ebe90-1203-4db4-ae5b-386274818972 from mountpoint /dev/vdb
Nov 03 14:11:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Attempting to detach device vdb from instance d5982d99-655e-4036-a0b3-20e1974feca3 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:11:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:11:25 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:25 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:11:25 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:25 user nova-compute[74582]:   <serial>9d2ebe90-1203-4db4-ae5b-386274818972</serial>
Nov 03 14:11:25 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:11:25 user nova-compute[74582]: </disk>
Nov 03 14:11:25 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:11:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully detached device vdb from instance d5982d99-655e-4036-a0b3-20e1974feca3 from the persistent domain config.
Nov 03 14:11:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5982d99-655e-4036-a0b3-20e1974feca3 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:11:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:11:25 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:25 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:11:25 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:25 user nova-compute[74582]:   <serial>9d2ebe90-1203-4db4-ae5b-386274818972</serial>
Nov 03 14:11:25 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:11:25 user nova-compute[74582]: </disk>
Nov 03 14:11:25 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:11:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5982d99-655e-4036-a0b3-20e1974feca3 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:11:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMwqEIBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:30 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:30 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:30 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cfe2de-17bf-42d7-a229-7e50afa3444c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:11:30 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a44ea2-d76d-4b5d-9ae6-ee376a87b3f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443] added
Nov 03 14:11:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b194b-f796-46b0-a4fa-637a8e402562]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c47a3e-0c51-4c0e-aa8c-82d5161877eb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMwqEIBt {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMwqEIBt" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[959836c7-2577-41d2-ad07-452c68822535]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OMwqEIBt'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bac5b9-72e1-42f1-8cb4-e9c955f08a43]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59aa7a8-7353-4366-9ee9-e7f4a4455ee8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:30 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:30 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:30 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d847ccb2-c5e3-4336-ab0d-3daa0cbba520]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260]
Nov 03 14:11:31 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260] successful.
Nov 03 14:11:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[161c1b3f-f03f-44a0-b817-c37134c5e14c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f062ca0-7fc5-470b-85be-c4c88f7ed07d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:31 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:31 user nova-compute[74582]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 (non-flash)
Nov 03 14:11:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:31 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:31 user nova-compute[74582]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 (non-flash)
Nov 03 14:11:31 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[340c1058-839f-4ed0-b275-ff8ff79472e0]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:11:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMwqEIBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23336396561613632', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336396561613632', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG nova.objects.instance [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lazy-loading 'flavor' on Instance uuid 339e891c-da3f-46a3-8303-0d88bb770627 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:11:32 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:32 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:11:32 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:32 user nova-compute[74582]:   <serial>e6956d3d-a1ee-46be-9ed3-d21d39389443</serial>
Nov 03 14:11:32 user nova-compute[74582]: </disk>
Nov 03 14:11:32 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] No VIF found with MAC fa:16:3e:6d:8d:13, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:11:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-863b9380-03d5-4cd6-b44c-e1d737af0976 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.877s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Stashing vm_state: active {{(pid=74582) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:11:35 user nova-compute[74582]: INFO nova.compute.claims [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Claim successful on node user
Nov 03 14:11:35 user nova-compute[74582]: INFO nova.compute.resource_tracker [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating resource usage from migration 7c28880d-0215-48cd-a512-672d49ce8538
Nov 03 14:11:35 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.654s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:35 user nova-compute[74582]: INFO nova.compute.manager [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Migrating
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:11:35 user nova-compute[74582]: INFO nova.compute.rpcapi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquired lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:11:35 user nova-compute[74582]: DEBUG nova.network.neutron [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG nova.objects.instance [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'flavor' on Instance uuid 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG nova.network.neutron [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating instance_info_cache with network_info: [{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Releasing lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:36 user nova-compute[74582]: INFO nova.compute.manager [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Attaching volume 64b0399f-2d2a-460f-8095-a504d2ae44ae to /dev/vdb
Nov 03 14:11:36 user nova-compute[74582]: DEBUG os_brick.utils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0a114c-b0d8-4bf2-bbf3-90ef121ff8ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Starting migrate_disk_and_power_off {{(pid=74582) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2867067e-278d-4b46-83f7-21070ae74970]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d1a66-fabc-4f85-97d0-a708f67157d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a581f96f-b672-4944-8efb-4161d330920e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:36 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc1e0aa-9212-4350-a661-fea9f16e8ce7]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG os_brick.utils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating existing volume attachment record: d46c1f67-b04d-4a56-ad9d-53dae939761b {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-16c4b6a0-9718-4cbc-ba6d-037e43ecc475 req-be5d9c32-78d6-4ca7-8f96-913e3b213b7c service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-vif-unplugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-16c4b6a0-9718-4cbc-ba6d-037e43ecc475 req-be5d9c32-78d6-4ca7-8f96-913e3b213b7c service nova] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-16c4b6a0-9718-4cbc-ba6d-037e43ecc475 req-be5d9c32-78d6-4ca7-8f96-913e3b213b7c service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-16c4b6a0-9718-4cbc-ba6d-037e43ecc475 req-be5d9c32-78d6-4ca7-8f96-913e3b213b7c service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:36 user nova-compute[74582]: DEBUG nova.compute.manager [req-16c4b6a0-9718-4cbc-ba6d-037e43ecc475 req-be5d9c32-78d6-4ca7-8f96-913e3b213b7c service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] No waiting events found dispatching network-vif-unplugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:11:36 user nova-compute[74582]: WARNING nova.compute.manager [req-16c4b6a0-9718-4cbc-ba6d-037e43ecc475 req-be5d9c32-78d6-4ca7-8f96-913e3b213b7c service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received unexpected event network-vif-unplugged-fe6be05a-ae7a-4022-b40e-faba879bc06f for instance with vm_state active and task_state resize_migrating.
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance destroyed successfully.
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-395639538',display_name='tempest-ServerActionsTestOtherB-server-395639538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-395639538',id=33,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHc9/jbfunoqVsUhLUu1pjLoR0V9zAk2xJMMTcjnRQGzg8BfzopXdOQ8CMQsm/bnvhMZdrP/DcHwcZwnlASxD9QF6FDnyfFwLjY5dKNP3gjQUH+twCkAlnrIC7JY2BNGg==',key_name='tempest-keypair-138063646',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e9f304de49fe4b2da95e3ea87508b5f7',ramdisk_id='',reservation_id='r-0ybfq9xk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1210177191',owner_user_name='tempest-ServerActionsTestOtherB-1210177191-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2d0bf6ce5845209edecb631b24433d',uuid=339e891c-da3f-46a3-8303-0d88bb770627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734693917-network", "vif_mac": "fa:16:3e:6d:8d:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converting VIF {"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734693917-network", "vif_mac": "fa:16:3e:6d:8d:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_vif [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe6be05a-ae, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61b512c9-811e-453a-bf88-b1fba8f7ba71) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:37 user nova-compute[74582]: INFO os_vif [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae')
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMwqEIBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:37 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c35a6b9-c7d3-48b5-a078-df6f1aca570c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:11:37 user nova-compute[74582]: No targets found.
Nov 03 14:11:37 user nova-compute[74582]: iSNS:
Nov 03 14:11:37 user nova-compute[74582]: No targets found.
Nov 03 14:11:37 user nova-compute[74582]: STATIC:
Nov 03 14:11:37 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443
Nov 03 14:11:37 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:37 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:37 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972
Nov 03 14:11:37 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:37 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:37 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66
Nov 03 14:11:37 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:37 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:37 user nova-compute[74582]: FIRMWARE:
Nov 03 14:11:37 user nova-compute[74582]: No targets found.
Nov 03 14:11:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:11:37 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:11:37 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c49627-d26c-4a63-ab64-a12e12574c71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db7681f-e8d4-4f79-a22a-14efc7d99662]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:37 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:37 user nova-compute[74582]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 (non-flash)
Nov 03 14:11:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:37 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:37 user nova-compute[74582]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 (non-flash)
Nov 03 14:11:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f880b51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755d877-c4bb-4477-af89-4fc25aa98cd2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[24542ae1-058d-4de1-8de0-9efdefbeb10e]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2658ee6d-2cfe-43e1-b772-4a4d55bec450]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708cee4-f284-4cc6-be02-26a26cff0a6f]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a890518-7eeb-4f2a-831b-2d1f83e223f0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7dca2-80c2-4fc5-b41a-c26948a1ce72]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260]
Nov 03 14:11:37 user nova-compute[74582]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443, portal: 172.16.0.220,3260] successful.
Nov 03 14:11:37 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:37 user nova-compute[74582]: INFO nova.compute.manager [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Detaching volume 46c95fe1-0909-41a4-b056-a1446f3b9f66
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[51722a53-2ab7-4347-995b-2deac76c6ae2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] <== disconnect_volume: return (320ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:37 user nova-compute[74582]: INFO nova.virt.block_device [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Attempting to driver detach volume 46c95fe1-0909-41a4-b056-a1446f3b9f66 from mountpoint /dev/vdb
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Attempting to detach device vdb from instance b29d365d-6c44-426c-9103-e4526f1805cd from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:11:37 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:37 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:11:37 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:37 user nova-compute[74582]:   <serial>46c95fe1-0909-41a4-b056-a1446f3b9f66</serial>
Nov 03 14:11:37 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:11:37 user nova-compute[74582]: </disk>
Nov 03 14:11:37 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:11:37 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully detached device vdb from instance b29d365d-6c44-426c-9103-e4526f1805cd from the persistent domain config.
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b29d365d-6c44-426c-9103-e4526f1805cd from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:11:37 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:37 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:11:37 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:37 user nova-compute[74582]:   <serial>46c95fe1-0909-41a4-b056-a1446f3b9f66</serial>
Nov 03 14:11:37 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:11:37 user nova-compute[74582]: </disk>
Nov 03 14:11:37 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize/disk /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b29d365d-6c44-426c-9103-e4526f1805cd {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "cp -r /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize/disk /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk" returned: 0 in 0.472s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize/disk.info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk.info {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] CMD "cp -r /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize/disk.info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk.info" returned: 0 in 0.034s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-441536fb-5c90-40ce-bb0d-f44d0d289114 req-3f77e625-f678-4aee-b644-c47ea2dc0c93 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-441536fb-5c90-40ce-bb0d-f44d0d289114 req-3f77e625-f678-4aee-b644-c47ea2dc0c93 service nova] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-441536fb-5c90-40ce-bb0d-f44d0d289114 req-3f77e625-f678-4aee-b644-c47ea2dc0c93 service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-441536fb-5c90-40ce-bb0d-f44d0d289114 req-3f77e625-f678-4aee-b644-c47ea2dc0c93 service nova] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-441536fb-5c90-40ce-bb0d-f44d0d289114 req-3f77e625-f678-4aee-b644-c47ea2dc0c93 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] No waiting events found dispatching network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:11:38 user nova-compute[74582]: WARNING nova.compute.manager [req-441536fb-5c90-40ce-bb0d-f44d0d289114 req-3f77e625-f678-4aee-b644-c47ea2dc0c93 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received unexpected event network-vif-plugged-fe6be05a-ae7a-4022-b40e-faba879bc06f for instance with vm_state active and task_state resize_migrating.
Nov 03 14:11:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Port fe6be05a-ae7a-4022-b40e-faba879bc06f binding to destination host user is already ACTIVE {{(pid=74582) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 14:11:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:11:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquired lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:11:39 user nova-compute[74582]: DEBUG nova.network.neutron [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating instance_info_cache with network_info: [{"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Releasing lock "refresh_cache-339e891c-da3f-46a3-8303-0d88bb770627" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG os_brick.utils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755ee2d-38f0-4f63-bc5d-be4f94b05a7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab85ede-de85-4f98-a0aa-cd532100df78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fdcb4-9b3c-4eef-9765-4967426098d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b772bad-15dc-43c6-92a2-d3b8113aa17f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:11:40 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:11:40 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264d15c-3d7b-42d0-919e-3d23b9cb7a7f]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:11:40 user nova-compute[74582]: DEBUG os_brick.utils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:45 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5982d99-655e-4036-a0b3-20e1974feca3 is timed out.
Nov 03 14:11:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully detached device vdb from instance d5982d99-655e-4036-a0b3-20e1974feca3 from the live domain config.
Nov 03 14:11:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OksZvVhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:45 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd1388-20de-4f0b-b962-3a0c45e9ab55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:11:45 user nova-compute[74582]: No targets found.
Nov 03 14:11:45 user nova-compute[74582]: iSNS:
Nov 03 14:11:45 user nova-compute[74582]: No targets found.
Nov 03 14:11:45 user nova-compute[74582]: STATIC:
Nov 03 14:11:45 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972
Nov 03 14:11:45 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:45 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:45 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66
Nov 03 14:11:45 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:45 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:45 user nova-compute[74582]: FIRMWARE:
Nov 03 14:11:45 user nova-compute[74582]: No targets found.
Nov 03 14:11:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:11:45 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:11:45 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c67335-eb88-4975-9bb9-fefe1185041a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3eb40-ab38-4b6f-a7cb-79a85c6e5eda]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:45 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:45 user nova-compute[74582]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 (non-flash)
Nov 03 14:11:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683648b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:11:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a5066a-73e3-4253-a418-cb0fd2c5c79b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b7419-65e6-40d0-9a4d-7da795a7b2c8]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d2bf2-3695-4115-a579-cddc359883f7]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adc5e1d-b718-46c4-bd57-239d43fefa95]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba8ddd-cd94-4406-872a-dbb8a91922c6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9580b35b-0c19-4280-935e-ccf09718f15c]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260]
Nov 03 14:11:46 user nova-compute[74582]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972, portal: 172.16.0.220,3260] successful.
Nov 03 14:11:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2ebe90-1203-4db4-ae5b-386274818972 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f3dcd-afc8-47e5-8109-721fc5cdbbaf]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] <== disconnect_volume: return (286ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:11:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:11:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:11:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:11:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:11:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'flavor' on Instance uuid d5982d99-655e-4036-a0b3-20e1974feca3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b9e85d4f-3b05-4ad7-b3e5-8f9bf0e909ad tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.901s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fICBELAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:57 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c3aef-acf3-4867-9758-48234dc650d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:11:57 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[708d35af-8a22-4387-9015-23d6a345cef0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae] added
Nov 03 14:11:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b813e-007f-4e3e-9059-a6c9de487e1b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9913af8-f0c0-488f-b148-d233b510c1fa]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fICBELAt {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fICBELAt" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bb8301-ee70-4fe1-b368-64d97d95f9e4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fICBELAt'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fde36c-59c0-4c29-bcc2-5d50f551e5c9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad3b46-ce6c-4fc9-b5a7-b8babb56dcd5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.volume.cinder [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Update attachment failed for attachment 69d93f2b-413a-4614-8072-565b12b47684. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6f2ad216-0343-4053-a1ec-b0a0804de709) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6f2ad216-0343-4053-a1ec-b0a0804de709)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6f2ad216-0343-4053-a1ec-b0a0804de709)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Traceback (most recent call last):
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     yield
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     network_info = self._finish_resize(context, instance, migration,
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     self._update_volume_attachments(context, instance, bdms)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     self.volume_api.attachment_update(
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     res = method(self, ctx, *args, **kwargs)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     with excutils.save_and_reraise_exception():
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     self.force_reraise()
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     raise self.value
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     return method.func(obj, *args, **kwargs)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     resp = self._update('/attachments/%s' % id, body)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     return self.request(url, method, **kwargs)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627]     raise exceptions.from_response(resp, body)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6f2ad216-0343-4053-a1ec-b0a0804de709)
Nov 03 14:11:57 user nova-compute[74582]: ERROR nova.compute.manager [instance: 339e891c-da3f-46a3-8303-0d88bb770627] 
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b04d3c-5378-4fbf-b7ca-6fdad9855351]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260]
Nov 03 14:11:57 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260] successful.
Nov 03 14:11:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c796ca3-dda7-4f24-9532-95c94a2a6bde]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: INFO nova.compute.manager [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f907cc-98c8-474e-ae7c-f5eeea14402b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:57 user nova-compute[74582]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:11:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:57 user nova-compute[74582]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:11:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b602d60-cebe-4dc0-b9df-22f073737152]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:11:57 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Deleted allocation for migration 7c28880d-0215-48cd-a512-672d49ce8538
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:11:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:11:58 user nova-compute[74582]: INFO nova.compute.manager [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Successfully reverted task state from resize_finish on failure for instance.
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server [None req-60218b1c-8dc7-4ca2-ae49-9a3c48d8438d tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6f2ad216-0343-4053-a1ec-b0a0804de709)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6348, in finish_resize
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6345, in finish_resize
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6f2ad216-0343-4053-a1ec-b0a0804de709)
Nov 03 14:11:58 user nova-compute[74582]: ERROR oslo_messaging.rpc.server 
Nov 03 14:11:58 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b29d365d-6c44-426c-9103-e4526f1805cd is timed out.
Nov 03 14:11:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully detached device vdb from instance b29d365d-6c44-426c-9103-e4526f1805cd from the live domain config.
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDGUlpNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:11:58 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fICBELAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26665333733373066', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665333733373066', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.378s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'flavor' on Instance uuid 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2481ae7-153a-42e7-a637-59fbf4426b8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:11:58 user nova-compute[74582]: No targets found.
Nov 03 14:11:58 user nova-compute[74582]: iSNS:
Nov 03 14:11:58 user nova-compute[74582]: No targets found.
Nov 03 14:11:58 user nova-compute[74582]: STATIC:
Nov 03 14:11:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66
Nov 03 14:11:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:58 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae
Nov 03 14:11:58 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:11:58 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:11:58 user nova-compute[74582]: FIRMWARE:
Nov 03 14:11:58 user nova-compute[74582]: No targets found.
Nov 03 14:11:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:11:58 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:11:58 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:11:58 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:11:58 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:11:58 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:11:58 user nova-compute[74582]:   <serial>64b0399f-2d2a-460f-8095-a504d2ae44ae</serial>
Nov 03 14:11:58 user nova-compute[74582]: </disk>
Nov 03 14:11:58 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca919f-1bba-482f-a867-5ed815c69620]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[01afe9aa-9498-4513-a563-d1663d20538e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:58 user nova-compute[74582]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:11:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 (non-flash)
Nov 03 14:11:58 user nova-compute[74582]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:11:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f687213f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe18c07e-e49a-4632-9a70-966ce0d17b46]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564141f-1605-4c68-b368-fa3ffabe9830]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4762d093-67f3-41fe-9c81-f74d6fa309a2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ddd45-8408-4dac-8419-bff224ff4df2]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06025468-5bb5-44fe-a925-dfd3b0258999]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[95851cc5-c976-44b6-82fd-874452b11183]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260]
Nov 03 14:11:58 user nova-compute[74582]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66, portal: 172.16.0.220,3260] successful.
Nov 03 14:11:58 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c21ca5-52ff-47fe-8109-594e5c80dcad]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== disconnect_volume: return (666ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:11:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:11:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:11:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] No VIF found with MAC fa:16:3e:df:26:a2, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:11:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2805b8b7-bb4d-4e91-ab7f-48acd0812a2e tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.799s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'flavor' on Instance uuid b29d365d-6c44-426c-9103-e4526f1805cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d76e9087-4297-41d4-a23a-900ffb02fd95 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.369s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.214s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:00 user nova-compute[74582]: INFO nova.compute.manager [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Terminating instance
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.compute.manager [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0978514-b862-4311-9f7a-342a3652e278 req-8f054158-1d92-40bb-a3f6-5e4fc2880788 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-vif-unplugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0978514-b862-4311-9f7a-342a3652e278 req-8f054158-1d92-40bb-a3f6-5e4fc2880788 service nova] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0978514-b862-4311-9f7a-342a3652e278 req-8f054158-1d92-40bb-a3f6-5e4fc2880788 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0978514-b862-4311-9f7a-342a3652e278 req-8f054158-1d92-40bb-a3f6-5e4fc2880788 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0978514-b862-4311-9f7a-342a3652e278 req-8f054158-1d92-40bb-a3f6-5e4fc2880788 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] No waiting events found dispatching network-vif-unplugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0978514-b862-4311-9f7a-342a3652e278 req-8f054158-1d92-40bb-a3f6-5e4fc2880788 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-vif-unplugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:12:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Instance destroyed successfully.
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'resources' on Instance uuid b29d365d-6c44-426c-9103-e4526f1805cd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-848214492',display_name='tempest-VolumesSnapshotTestJSON-instance-848214492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-848214492',id=35,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAdgwh30ermBgOVSC6oy1cKx9wunXR1K/kJxG4gNhlyf/X5XOreP1kqDk8FDHcZbFDolw70u4uBAyQvBpB1qkIMmD84gRmFz6FDu2MhQR8BezAUGjvDwwIcLhW7XZ16fw==',key_name='tempest-keypair-1161947357',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:08:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72750b673ec946e08a94d8691bfc8e83',ramdisk_id='',reservation_id='r-lfh7sf0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2065237936',owner_user_name='tempest-VolumesSnapshotTestJSON-2065237936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21a795451e044a8394ff26ca920c44f1',uuid=b29d365d-6c44-426c-9103-e4526f1805cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converting VIF {"id": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "address": "fa:16:3e:48:64:fe", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3ebab0e-13", "ovs_interfaceid": "a3ebab0e-13b2-43cb-add3-96b240db4ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_vif [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3ebab0e-13, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d47caafd-3f74-4034-8ef1-12c1e4476817) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:00 user nova-compute[74582]: INFO os_vif [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a3ebab0e-13b2-43cb-add3-96b240db4ea0,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3ebab0e-13')
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDGUlpNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:12:00 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[13328543-83f1-46ab-ab89-4d9b5d2c3b56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:12:00 user nova-compute[74582]: No targets found.
Nov 03 14:12:00 user nova-compute[74582]: iSNS:
Nov 03 14:12:00 user nova-compute[74582]: No targets found.
Nov 03 14:12:00 user nova-compute[74582]: STATIC:
Nov 03 14:12:00 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae
Nov 03 14:12:00 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:12:00 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:12:00 user nova-compute[74582]: FIRMWARE:
Nov 03 14:12:00 user nova-compute[74582]: No targets found.
Nov 03 14:12:00 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:12:00 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:12:00 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c95fe1-0909-41a4-b056-a1446f3b9f66', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[465f5709-08dc-4737-addf-487e7f68bc39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff35475-ebf9-4ea5-b2e9-6ab725ec3b49]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:12:00 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:12:00 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f487a0280>, {}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Disconnecting from: [] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== disconnect_volume: return (64ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:12:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Deleting instance files /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd_del
Nov 03 14:12:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Deletion of /opt/stack/data/nova/instances/b29d365d-6c44-426c-9103-e4526f1805cd_del complete
Nov 03 14:12:00 user nova-compute[74582]: INFO nova.compute.manager [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 14:12:00 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:12:00 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:12:01 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:01 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Took 0.79 seconds to deallocate network for instance.
Nov 03 14:12:01 user nova-compute[74582]: WARNING nova.volume.cinder [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Attachment 1d5883c3-faa2-43cb-af30-96eb7a64e2e3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1d5883c3-faa2-43cb-af30-96eb7a64e2e3. (HTTP 404) (Request-ID: req-5ab625d4-9e49-4c2c-bbae-7549880e7fd7)
Nov 03 14:12:01 user nova-compute[74582]: INFO nova.compute.manager [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Took 0.04 seconds to detach 1 volumes for instance.
Nov 03 14:12:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing instance network info cache due to event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:02 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Deleted allocations for instance b29d365d-6c44-426c-9103-e4526f1805cd
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-0607937b-e682-4181-984b-906908b280cf tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "b29d365d-6c44-426c-9103-e4526f1805cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] Acquiring lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] Lock "b29d365d-6c44-426c-9103-e4526f1805cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] No waiting events found dispatching network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:02 user nova-compute[74582]: WARNING nova.compute.manager [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received unexpected event network-vif-plugged-a3ebab0e-13b2-43cb-add3-96b240db4ea0 for instance with vm_state deleted and task_state None.
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-dba7e61f-1b68-467a-9532-a2ddbfcd225a req-4ed72cf6-2686-46f0-91b3-a6fd66083326 service nova] [instance: b29d365d-6c44-426c-9103-e4526f1805cd] Received event network-vif-deleted-a3ebab0e-13b2-43cb-add3-96b240db4ea0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updated VIF entry in instance network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c91f3b18-c66e-4eb7-9f23-503b437298e7 req-f625ca12-17fc-4759-bdf5-1e8479007f5d service nova] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:12:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing instance network info cache due to event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.network.neutron [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.network.neutron [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updated VIF entry in instance network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.network.neutron [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ffe1bc0c-e16d-4a34-b79a-f94992f6dbaf req-4412134b-788f-4d79-b2e6-6cb62e6fa2df service nova] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:04 user nova-compute[74582]: INFO nova.compute.manager [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Rebooting instance
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:12:04 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:12:05 user nova-compute[74582]: DEBUG nova.network.neutron [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:12:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:12:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-3a5507aa-5d1d-4f3d-a109-8b5f5548e99a req-1ece2b53-5f0b-4f0e-8134-b75c7f7fb7ea service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-unplugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3a5507aa-5d1d-4f3d-a109-8b5f5548e99a req-1ece2b53-5f0b-4f0e-8134-b75c7f7fb7ea service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3a5507aa-5d1d-4f3d-a109-8b5f5548e99a req-1ece2b53-5f0b-4f0e-8134-b75c7f7fb7ea service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3a5507aa-5d1d-4f3d-a109-8b5f5548e99a req-1ece2b53-5f0b-4f0e-8134-b75c7f7fb7ea service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-3a5507aa-5d1d-4f3d-a109-8b5f5548e99a req-1ece2b53-5f0b-4f0e-8134-b75c7f7fb7ea service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-unplugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:08 user nova-compute[74582]: WARNING nova.compute.manager [req-3a5507aa-5d1d-4f3d-a109-8b5f5548e99a req-1ece2b53-5f0b-4f0e-8134-b75c7f7fb7ea service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-unplugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state active and task_state reboot_started.
Nov 03 14:12:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance shutdown successfully.
Nov 03 14:12:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-091f95a7-4f3e-4888-9032-e0a2c4050501 req-a7e12669-fb49-49c3-aa27-7634d31d1301 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-091f95a7-4f3e-4888-9032-e0a2c4050501 req-a7e12669-fb49-49c3-aa27-7634d31d1301 service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-091f95a7-4f3e-4888-9032-e0a2c4050501 req-a7e12669-fb49-49c3-aa27-7634d31d1301 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-091f95a7-4f3e-4888-9032-e0a2c4050501 req-a7e12669-fb49-49c3-aa27-7634d31d1301 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-091f95a7-4f3e-4888-9032-e0a2c4050501 req-a7e12669-fb49-49c3-aa27-7634d31d1301 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:10 user nova-compute[74582]: WARNING nova.compute.manager [req-091f95a7-4f3e-4888-9032-e0a2c4050501 req-a7e12669-fb49-49c3-aa27-7634d31d1301 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state active and task_state reboot_started.
Nov 03 14:12:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance running successfully.
Nov 03 14:12:12 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance soft rebooted successfully.
Nov 03 14:12:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3e3aa9f8-5854-4b82-b8a3-d00c4b20865c tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.538s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:12 user nova-compute[74582]: WARNING nova.compute.manager [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state active and task_state None.
Nov 03 14:12:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:12 user nova-compute[74582]: WARNING nova.compute.manager [req-61c58444-e2e2-4ab1-a351-ad83df3585ce req-ebfeae1a-5129-4e70-9c11-e00780bff90c service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state active and task_state None.
Nov 03 14:12:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating instance_info_cache with network_info: [{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:12:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:12:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-changed-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Refreshing instance network info cache due to event network-changed-40752499-34b9-442e-ae6d-6faf96238122. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] Acquiring lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] Acquired lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Refreshing network info cache for port 40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:16 user nova-compute[74582]: INFO nova.compute.manager [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Terminating instance
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updated VIF entry in instance network info cache for port 40752499-34b9-442e-ae6d-6faf96238122. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating instance_info_cache with network_info: [{"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f559eb62-0fdf-4abf-8437-f51e02781ed3 req-a66b2d29-6e8e-4af5-baef-1737dedab310 service nova] Releasing lock "refresh_cache-d5982d99-655e-4036-a0b3-20e1974feca3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Instance destroyed successfully.
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.objects.instance [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'resources' on Instance uuid d5982d99-655e-4036-a0b3-20e1974feca3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2127551426',display_name='tempest-TestStampPattern-server-2127551426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2127551426',id=37,image_ref='27e72d8e-a50f-47d2-8a15-77a91aac899c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtb8RAC35Ay0NuOoY0sqUucIv1xSQ5rEt2guSpAdeXJNP1NDaO8I8qlX3itFFRV8dIepDCZk1yyH9FZ6lG5GcbOOfXTSmewWSLa+X/BsbXndkr4Ujjx09AOtfXavppNwg==',key_name='tempest-TestStampPattern-1127467608',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77a5c94d1094e269259d0b6037319aa',ramdisk_id='',reservation_id='r-c1wgxh0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8f30eb65-1553-4f18-a861-b97e58dda769',image_min_disk='1',image_min_ram='0',image_owner_id='d77a5c94d1094e269259d0b6037319aa',image_owner_project_name='tempest-TestStampPattern-722996733',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-722996733-project-member',image_user_id='db5774b6cb564ba98174b4cf04888359',owner_project_name='tempest-TestStampPattern-722996733',owner_user_name='tempest-TestStampPattern-722996733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:09:16Z,user_data=None,user_id='db5774b6cb564ba98174b4cf04888359',uuid=d5982d99-655e-4036-a0b3-20e1974feca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converting VIF {"id": "40752499-34b9-442e-ae6d-6faf96238122", "address": "fa:16:3e:e4:c5:a7", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40752499-34", "ovs_interfaceid": "40752499-34b9-442e-ae6d-6faf96238122", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG os_vif [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40752499-34, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2bebe26-de92-48a5-8bad-12f051c341dc) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:16 user nova-compute[74582]: INFO os_vif [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:c5:a7,bridge_name='br-int',has_traffic_filtering=True,id=40752499-34b9-442e-ae6d-6faf96238122,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40752499-34')
Nov 03 14:12:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Deleting instance files /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3_del
Nov 03 14:12:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Deletion of /opt/stack/data/nova/instances/d5982d99-655e-4036-a0b3-20e1974feca3_del complete
Nov 03 14:12:16 user nova-compute[74582]: INFO nova.compute.manager [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 03 14:12:16 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:12:16 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-3f7647e2-2fad-4ae8-8b6d-dea2b305929f req-93180e3f-cff2-4daa-9c60-8e097ea0f7a4 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-vif-deleted-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:17 user nova-compute[74582]: INFO nova.compute.manager [req-3f7647e2-2fad-4ae8-8b6d-dea2b305929f req-93180e3f-cff2-4daa-9c60-8e097ea0f7a4 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Neutron deleted interface 40752499-34b9-442e-ae6d-6faf96238122; detaching it from the instance and deleting it from the info cache
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.network.neutron [req-3f7647e2-2fad-4ae8-8b6d-dea2b305929f req-93180e3f-cff2-4daa-9c60-8e097ea0f7a4 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:17 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Took 0.47 seconds to deallocate network for instance.
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-3f7647e2-2fad-4ae8-8b6d-dea2b305929f req-93180e3f-cff2-4daa-9c60-8e097ea0f7a4 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Detach interface failed, port_id=40752499-34b9-442e-ae6d-6faf96238122, reason: Instance d5982d99-655e-4036-a0b3-20e1974feca3 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:17 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Deleted allocations for instance d5982d99-655e-4036-a0b3-20e1974feca3
Nov 03 14:12:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8085614c-3937-4736-b16d-20c1d1a96313 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "d5982d99-655e-4036-a0b3-20e1974feca3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-vif-unplugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] No waiting events found dispatching network-vif-unplugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:18 user nova-compute[74582]: WARNING nova.compute.manager [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received unexpected event network-vif-unplugged-40752499-34b9-442e-ae6d-6faf96238122 for instance with vm_state deleted and task_state None.
Nov 03 14:12:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received event network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] Acquiring lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] Lock "d5982d99-655e-4036-a0b3-20e1974feca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] No waiting events found dispatching network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:18 user nova-compute[74582]: WARNING nova.compute.manager [req-2fa5357a-76e9-4389-b314-036cc31fd55b req-08579fe9-a641-4d93-a507-37ed2a80a636 service nova] [instance: d5982d99-655e-4036-a0b3-20e1974feca3] Received unexpected event network-vif-plugged-40752499-34b9-442e-ae6d-6faf96238122 for instance with vm_state deleted and task_state None.
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:12:20 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8327MB free_disk=24.915462493896484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Applying migration context for instance 339e891c-da3f-46a3-8303-0d88bb770627 as it has an incoming, in-progress migration 7c28880d-0215-48cd-a512-672d49ce8538. Migration status is error {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74582) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 50562940-704d-4c03-a99e-c1e94dc6559e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance bec6a7a3-3cf4-476a-901e-fa139908bb8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 339e891c-da3f-46a3-8303-0d88bb770627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:12:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'flavor' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:37 user nova-compute[74582]: INFO nova.compute.manager [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Attaching volume 5c6ccf9c-2ee4-4277-a510-1245b1390ff4 to /dev/vdb
Nov 03 14:12:37 user nova-compute[74582]: DEBUG os_brick.utils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669f18e-7da7-499c-ac95-006857ba3ada]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaca9f1-eda1-4dab-8fa4-493f61c35b9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04557e-5ffb-491c-9e89-2ea8f5ac4095]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d71606b-b352-430d-88c5-57a8b8047e11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:12:37 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:12:37 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe1e01b-021a-4479-9dd3-e9a7b0a91176]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG os_brick.utils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:12:37 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating existing volume attachment record: 106ff9ca-32f5-4ffb-a0c1-27f8f71966c1 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:12:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:50 user nova-compute[74582]: INFO nova.compute.manager [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Terminating instance
Nov 03 14:12:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-56054f19-071c-4121-a080-35b129344076 req-8be06c74-e325-43c0-938e-5b885af76554 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-vif-unplugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-56054f19-071c-4121-a080-35b129344076 req-8be06c74-e325-43c0-938e-5b885af76554 service nova] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-56054f19-071c-4121-a080-35b129344076 req-8be06c74-e325-43c0-938e-5b885af76554 service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-56054f19-071c-4121-a080-35b129344076 req-8be06c74-e325-43c0-938e-5b885af76554 service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-56054f19-071c-4121-a080-35b129344076 req-8be06c74-e325-43c0-938e-5b885af76554 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] No waiting events found dispatching network-vif-unplugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-56054f19-071c-4121-a080-35b129344076 req-8be06c74-e325-43c0-938e-5b885af76554 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-vif-unplugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:12:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Instance destroyed successfully.
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lazy-loading 'resources' on Instance uuid bec6a7a3-3cf4-476a-901e-fa139908bb8d {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-526082533',display_name='tempest-VolumesActionsTest-instance-526082533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-526082533',id=39,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfcde03473d540bf8c8ea8c0828d2f5f',ramdisk_id='',reservation_id='r-mh4or0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1616593314',owner_user_name='tempest-VolumesActionsTest-1616593314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:11:06Z,user_data=None,user_id='ac294094d1a04b5bb8bb411fd2f01abf',uuid=bec6a7a3-3cf4-476a-901e-fa139908bb8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converting VIF {"id": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "address": "fa:16:3e:25:66:64", "network": {"id": "333b363d-a755-4b07-bd82-fa227621b133", "bridge": "br-int", "label": "tempest-VolumesActionsTest-188802681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcde03473d540bf8c8ea8c0828d2f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bdb9c4-74", "ovs_interfaceid": "a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG os_vif [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2bdb9c4-74, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0327daaf-93b9-4342-b692-9b6deee71a20) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:12:51 user nova-compute[74582]: INFO os_vif [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:64,bridge_name='br-int',has_traffic_filtering=True,id=a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c,network=Network(333b363d-a755-4b07-bd82-fa227621b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bdb9c4-74')
Nov 03 14:12:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Deleting instance files /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d_del
Nov 03 14:12:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Deletion of /opt/stack/data/nova/instances/bec6a7a3-3cf4-476a-901e-fa139908bb8d_del complete
Nov 03 14:12:51 user nova-compute[74582]: INFO nova.compute.manager [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 03 14:12:51 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:12:51 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:12:51 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Took 0.46 seconds to deallocate network for instance.
Nov 03 14:12:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-5f6ed033-6e3d-462b-8116-372f07f679c9 req-95afeea1-3491-41bf-950e-bc210215cda6 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-vif-deleted-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:52 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:12:52 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:12:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:52 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Deleted allocations for instance bec6a7a3-3cf4-476a-901e-fa139908bb8d
Nov 03 14:12:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-95d60129-aa62-453a-9bb2-c9da3968a333 tempest-VolumesActionsTest-1616593314 tempest-VolumesActionsTest-1616593314-project-member] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.671s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-acbc7bdb-fc18-44db-a239-8068db1aeecf req-ea67630b-6150-40f4-b707-ca11532fd5c9 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received event network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:12:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-acbc7bdb-fc18-44db-a239-8068db1aeecf req-ea67630b-6150-40f4-b707-ca11532fd5c9 service nova] Acquiring lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:12:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-acbc7bdb-fc18-44db-a239-8068db1aeecf req-ea67630b-6150-40f4-b707-ca11532fd5c9 service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:12:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-acbc7bdb-fc18-44db-a239-8068db1aeecf req-ea67630b-6150-40f4-b707-ca11532fd5c9 service nova] Lock "bec6a7a3-3cf4-476a-901e-fa139908bb8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-acbc7bdb-fc18-44db-a239-8068db1aeecf req-ea67630b-6150-40f4-b707-ca11532fd5c9 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] No waiting events found dispatching network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:12:53 user nova-compute[74582]: WARNING nova.compute.manager [req-acbc7bdb-fc18-44db-a239-8068db1aeecf req-ea67630b-6150-40f4-b707-ca11532fd5c9 service nova] [instance: bec6a7a3-3cf4-476a-901e-fa139908bb8d] Received unexpected event network-vif-plugged-a2bdb9c4-7434-4b55-8df4-39f9a7b20e6c for instance with vm_state deleted and task_state None.
Nov 03 14:12:56 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:12:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:12:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 0 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:12:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdfHAnPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:12:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:12:57 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:12:57 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afa1503-3d99-4b9e-bd69-7e3cccc486ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:12:57 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[14176cd1-1c2d-4831-8f77-53ec077895db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4] added
Nov 03 14:12:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb44236-daeb-44f3-8c34-4c065a82bc2d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ac667-d128-4476-b31d-0e1b993ddfdb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdfHAnPM {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdfHAnPM" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23234f8-c6b0-4740-a32e-dc8a0a103f43]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mdfHAnPM'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8febed8-3414-4d42-ba99-2f2729294790]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4de79-125d-4bb7-bf66-fd10102f8a7c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:12:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:12:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda0a6b9-ca93-4fb2-828d-e30dd9f1676c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260]
Nov 03 14:12:57 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260] successful.
Nov 03 14:12:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[287cef0d-c136-46b6-8d64-7ca94b0e9f58]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa41f37-992f-4d6f-8663-f9146348b290]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:12:57 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:12:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:12:57 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:12:57 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d563de35-fa9b-4494-85b4-cb18edc014fe]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:12:57 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdfHAnPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23737613139323633', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737613139323633', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'flavor' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:12:58 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:12:58 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:12:58 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:12:58 user nova-compute[74582]:   <serial>5c6ccf9c-2ee4-4277-a510-1245b1390ff4</serial>
Nov 03 14:12:58 user nova-compute[74582]: </disk>
Nov 03 14:12:58 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:12:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No VIF found with MAC fa:16:3e:8f:20:d1, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:12:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5c714bf3-ca68-4188-81d3-8fd95c515c06 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.756s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:12:59 user nova-compute[74582]: INFO nova.compute.manager [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Rescuing
Nov 03 14:12:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:12:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:12:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-d46b18fb-01b9-42f5-a0f9-f96e15539612 req-c6364108-1d12-404a-a79a-a30b56f120f0 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d46b18fb-01b9-42f5-a0f9-f96e15539612 req-c6364108-1d12-404a-a79a-a30b56f120f0 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d46b18fb-01b9-42f5-a0f9-f96e15539612 req-c6364108-1d12-404a-a79a-a30b56f120f0 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d46b18fb-01b9-42f5-a0f9-f96e15539612 req-c6364108-1d12-404a-a79a-a30b56f120f0 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-d46b18fb-01b9-42f5-a0f9-f96e15539612 req-c6364108-1d12-404a-a79a-a30b56f120f0 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:00 user nova-compute[74582]: WARNING nova.compute.manager [req-d46b18fb-01b9-42f5-a0f9-f96e15539612 req-c6364108-1d12-404a-a79a-a30b56f120f0 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state rescuing.
Nov 03 14:13:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance destroyed successfully.
Nov 03 14:13:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Attempting a stable device rescue
Nov 03 14:13:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74582) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 14:13:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 14:13:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Creating image(s)
Nov 03 14:13:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'trusted_certs' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "91f07e8fe1b58a0542b77d59a60391c3f241f36b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "91f07e8fe1b58a0542b77d59a60391c3f241f36b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.part --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG nova.virt.images [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] 4af3439c-c9ae-467b-b35b-854c9d3e3dc2 was qcow2, converting to raw {{(pid=74582) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG nova.privsep.utils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74582) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.part /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.converted {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.part /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.converted" returned: 0 in 0.209s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.converted --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-542928fd-5c49-4f95-821f-9b775bcbeb1e req-1e4967ce-2fe0-49ca-8c60-1cddc7a46146 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-542928fd-5c49-4f95-821f-9b775bcbeb1e req-1e4967ce-2fe0-49ca-8c60-1cddc7a46146 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-542928fd-5c49-4f95-821f-9b775bcbeb1e req-1e4967ce-2fe0-49ca-8c60-1cddc7a46146 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-542928fd-5c49-4f95-821f-9b775bcbeb1e req-1e4967ce-2fe0-49ca-8c60-1cddc7a46146 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-542928fd-5c49-4f95-821f-9b775bcbeb1e req-1e4967ce-2fe0-49ca-8c60-1cddc7a46146 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:02 user nova-compute[74582]: WARNING nova.compute.manager [req-542928fd-5c49-4f95-821f-9b775bcbeb1e req-1e4967ce-2fe0-49ca-8c60-1cddc7a46146 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state rescuing.
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "91f07e8fe1b58a0542b77d59a60391c3f241f36b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.573s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "91f07e8fe1b58a0542b77d59a60391c3f241f36b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "91f07e8fe1b58a0542b77d59a60391c3f241f36b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:02 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b,backing_fmt=raw /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b,backing_fmt=raw /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue" returned: 0 in 0.049s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "91f07e8fe1b58a0542b77d59a60391c3f241f36b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'migration_context' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Object Instance<d62d7210-0ba4-4224-887b-ec3266072bb0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Start _get_guest_xml network_info=[{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "vif_mac": "fa:16:3e:8f:20:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4af3439c-c9ae-467b-b35b-854c9d3e3dc2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '106ff9ca-32f5-4ffb-a0c1-27f8f71966c1', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdfHAnPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd62d7210-0ba4-4224-887b-ec3266072bb0', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'serial': '5c6ccf9c-2ee4-4277-a510-1245b1390ff4'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'resources' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Object Instance<d62d7210-0ba4-4224-887b-ec3266072bb0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'numa_topology' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Object Instance<d62d7210-0ba4-4224-887b-ec3266072bb0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:13:03 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:13:03 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'vcpu_model' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Object Instance<d62d7210-0ba4-4224-887b-ec3266072bb0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdfHAnPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:13:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:13:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:13:03 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4445d4-8952-47a8-867e-bffbb6210138]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mdfHAnPM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 14:13:03 user nova-compute[74582]: node.name = iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4
Nov 03 14:13:03 user nova-compute[74582]: node.tpgt = -1
Nov 03 14:13:03 user nova-compute[74582]: node.startup = automatic
Nov 03 14:13:03 user nova-compute[74582]: node.leading_login = No
Nov 03 14:13:03 user nova-compute[74582]: iface.iscsi_ifacename = default
Nov 03 14:13:03 user nova-compute[74582]: iface.net_ifacename = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.ipaddress = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.prefix_len = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.hwaddress = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.transport_name = tcp
Nov 03 14:13:03 user nova-compute[74582]: iface.initiatorname = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.vlan_id = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.vlan_priority = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.vlan_state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.iface_num = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.mtu = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.port = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.bootproto = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.subnet_mask = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.gateway = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_alt_client_id = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_dns = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_learn_iqn = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_vendor_id_state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_vendor_id = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.dhcp_slp_da = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.fragmentation = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.gratuitous_arp = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.incoming_forwarding = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.tos_state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.tos = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.ttl = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.delayed_ack = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.tcp_nagle = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.tcp_wsf_state = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.tcp_wsf = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.tcp_timer_scale = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.tcp_timestamp = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.redirect = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.def_task_mgmt_timeout = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.header_digest = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.data_digest = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.immediate_data = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.initial_r2t = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.data_seq_inorder = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.data_pdu_inorder = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.erl = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.max_receive_data_len = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.first_burst_len = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.max_outstanding_r2t = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.max_burst_len = 0
Nov 03 14:13:03 user nova-compute[74582]: iface.chap_auth = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.bidi_chap = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.strict_login_compliance = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.discovery_auth = <empty>
Nov 03 14:13:03 user nova-compute[74582]: iface.discovery_logout = <empty>
Nov 03 14:13:03 user nova-compute[74582]: node.discovery_address = <empty>
Nov 03 14:13:03 user nova-compute[74582]: node.discovery_port = 0
Nov 03 14:13:03 user nova-compute[74582]: node.discovery_type = static
Nov 03 14:13:03 user nova-compute[74582]: node.session.initial_cmdsn = 0
Nov 03 14:13:03 user nova-compute[74582]: node.session.initial_login_retry_max = 8
Nov 03 14:13:03 user nova-compute[74582]: node.session.xmit_thread_priority = -20
Nov 03 14:13:03 user nova-compute[74582]: node.session.cmds_max = 128
Nov 03 14:13:03 user nova-compute[74582]: node.session.queue_depth = 32
Nov 03 14:13:03 user nova-compute[74582]: node.session.nr_sessions = 1
Nov 03 14:13:03 user nova-compute[74582]: node.session.auth.authmethod = CHAP
Nov 03 14:13:03 user nova-compute[74582]: node.session.auth.username = mdfHAnPM
Nov 03 14:13:03 user nova-compute[74582]: node.session.auth.password = ***
Nov 03 14:13:03 user nova-compute[74582]: node.session.auth.username_in = <empty>
Nov 03 14:13:03 user nova-compute[74582]: node.session.auth.password_in = <empty>
Nov 03 14:13:03 user nova-compute[74582]: node.session.auth.chap_algs = MD5
Nov 03 14:13:03 user nova-compute[74582]: node.session.timeo.replacement_timeout = 120
Nov 03 14:13:03 user nova-compute[74582]: node.session.err_timeo.abort_timeout = 15
Nov 03 14:13:03 user nova-compute[74582]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 14:13:03 user nova-compute[74582]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 14:13:03 user nova-compute[74582]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.FastAbort = Yes
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.InitialR2T = No
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.ImmediateData = Yes
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.MaxConnections = 1
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 14:13:03 user nova-compute[74582]: node.session.iscsi.ERL = 0
Nov 03 14:13:03 user nova-compute[74582]: node.session.scan = manual
Nov 03 14:13:03 user nova-compute[74582]: node.session.reopen_max = 0
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].address = 172.16.0.220
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].port = 3260
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].startup = manual
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].tcp.window_size = 524288
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].tcp.type_of_service = 0
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].timeo.logout_timeout = 15
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].timeo.login_timeout = 15
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].timeo.auth_timeout = 45
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].iscsi.DataDigest = None
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].iscsi.IFMarker = No
Nov 03 14:13:03 user nova-compute[74582]: node.conn[0].iscsi.OFMarker = No
Nov 03 14:13:03 user nova-compute[74582]: # END RECORD
Nov 03 14:13:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfaf91f-2145-4a19-a413-b9b52e06147d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b81be-94c5-4c9c-8ee3-b4946df67d10]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdfHAnPM {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdfHAnPM" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbbbf1-5e0f-4fb4-a3e7-3d9adb07114b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mdfHAnPM'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c7f87-3543-4556-86d7-78cf2199f185]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87c1b7d-d444-45fc-8433-3d99a7c309dd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:13:03 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:13:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:13:03 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:13:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] HCTL ('33', '0', '0', 0) found on session 45 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8947a22f-bc0d-4a22-94f8-761aebe2ca3c]: (4, ('0 0 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Searching for a device in session 45 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdfHAnPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] <== connect_volume: return (172ms) {'type': 'block', 'scsi_wwn': '23737613139323633', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737613139323633', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2073427584',display_name='tempest-ServerStableDeviceRescueTest-server-2073427584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2073427584',id=36,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLhMeU162JG7Wng8TnrmOxRS8FG4U7S7wLMbRvIFxpbtkI/cevU3/s+YwrSS1eY4canYYaWf88nqSBbhPKZQhuHHZdBZcG+zEyHX2KORDFjb/M0IiTJF54s987Tn3lRWA==',key_name='tempest-keypair-984564094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:09:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d445081fe9645b0961089dfa2c9ca85',ramdisk_id='',reservation_id='r-wp79qwwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1359208006',owner_user_name='tempest-ServerStableDeviceRescueTest-1359208006-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06455365cee44bea82e923ffb923b23f',uuid=d62d7210-0ba4-4224-887b-ec3266072bb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "vif_mac": "fa:16:3e:8f:20:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converting VIF {"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "vif_mac": "fa:16:3e:8f:20:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'pci_devices' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.objects.base [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Object Instance<d62d7210-0ba4-4224-887b-ec3266072bb0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:13:03 user nova-compute[74582]:   <uuid>d62d7210-0ba4-4224-887b-ec3266072bb0</uuid>
Nov 03 14:13:03 user nova-compute[74582]:   <name>instance-00000024</name>
Nov 03 14:13:03 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:13:03 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:13:03 user nova-compute[74582]:   <metadata>
Nov 03 14:13:03 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:13:03 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:13:03 user nova-compute[74582]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2073427584</nova:name>
Nov 03 14:13:03 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:13:03</nova:creationTime>
Nov 03 14:13:03 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:13:03 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:13:03 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:13:03 user nova-compute[74582]:       <nova:owner>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:user uuid="06455365cee44bea82e923ffb923b23f">tempest-ServerStableDeviceRescueTest-1359208006-project-member</nova:user>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:project uuid="0d445081fe9645b0961089dfa2c9ca85">tempest-ServerStableDeviceRescueTest-1359208006</nova:project>
Nov 03 14:13:03 user nova-compute[74582]:       </nova:owner>
Nov 03 14:13:03 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:13:03 user nova-compute[74582]:       <nova:ports>
Nov 03 14:13:03 user nova-compute[74582]:         <nova:port uuid="3673527d-6ca0-48b6-b6ee-b8ab9f4270c4">
Nov 03 14:13:03 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 14:13:03 user nova-compute[74582]:         </nova:port>
Nov 03 14:13:03 user nova-compute[74582]:       </nova:ports>
Nov 03 14:13:03 user nova-compute[74582]:     </nova:instance>
Nov 03 14:13:03 user nova-compute[74582]:   </metadata>
Nov 03 14:13:03 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:13:03 user nova-compute[74582]:     <system>
Nov 03 14:13:03 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:13:03 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:13:03 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:13:03 user nova-compute[74582]:       <entry name="serial">d62d7210-0ba4-4224-887b-ec3266072bb0</entry>
Nov 03 14:13:03 user nova-compute[74582]:       <entry name="uuid">d62d7210-0ba4-4224-887b-ec3266072bb0</entry>
Nov 03 14:13:03 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:13:03 user nova-compute[74582]:     </system>
Nov 03 14:13:03 user nova-compute[74582]:   </sysinfo>
Nov 03 14:13:03 user nova-compute[74582]:   <os>
Nov 03 14:13:03 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:13:03 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:13:03 user nova-compute[74582]:   </os>
Nov 03 14:13:03 user nova-compute[74582]:   <features>
Nov 03 14:13:03 user nova-compute[74582]:     <acpi/>
Nov 03 14:13:03 user nova-compute[74582]:     <apic/>
Nov 03 14:13:03 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:13:03 user nova-compute[74582]:   </features>
Nov 03 14:13:03 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:13:03 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:13:03 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:13:03 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:13:03 user nova-compute[74582]:   </clock>
Nov 03 14:13:03 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:13:03 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:13:03 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:13:03 user nova-compute[74582]:   </cpu>
Nov 03 14:13:03 user nova-compute[74582]:   <devices>
Nov 03 14:13:03 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:13:03 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:13:03 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk"/>
Nov 03 14:13:03 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:13:03 user nova-compute[74582]:     </disk>
Nov 03 14:13:03 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:13:03 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:13:03 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 14:13:03 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:13:03 user nova-compute[74582]:       <serial>5c6ccf9c-2ee4-4277-a510-1245b1390ff4</serial>
Nov 03 14:13:03 user nova-compute[74582]:     </disk>
Nov 03 14:13:03 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:13:03 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:13:03 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue"/>
Nov 03 14:13:03 user nova-compute[74582]:       <target dev="vdc" bus="virtio"/>
Nov 03 14:13:03 user nova-compute[74582]:       <boot order="1"/>
Nov 03 14:13:03 user nova-compute[74582]:     </disk>
Nov 03 14:13:03 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:13:03 user nova-compute[74582]:       <mac address="fa:16:3e:8f:20:d1"/>
Nov 03 14:13:03 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:13:03 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:13:03 user nova-compute[74582]:       <target dev="tap3673527d-6c"/>
Nov 03 14:13:03 user nova-compute[74582]:     </interface>
Nov 03 14:13:03 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:13:03 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/console.log" append="off"/>
Nov 03 14:13:03 user nova-compute[74582]:     </serial>
Nov 03 14:13:03 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:13:03 user nova-compute[74582]:     <video>
Nov 03 14:13:03 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:13:03 user nova-compute[74582]:     </video>
Nov 03 14:13:03 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:13:03 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:13:03 user nova-compute[74582]:     </rng>
Nov 03 14:13:03 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:13:03 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:13:03 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:13:03 user nova-compute[74582]:     </memballoon>
Nov 03 14:13:03 user nova-compute[74582]:   </devices>
Nov 03 14:13:03 user nova-compute[74582]: </domain>
Nov 03 14:13:03 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:13:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance destroyed successfully.
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:13:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] No VIF found with MAC fa:16:3e:8f:20:d1, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-23c694c6-90af-46e1-a2ef-6e6393b91bee req-d762a5b9-6b7e-46ec-9764-5275e56b2f31 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-23c694c6-90af-46e1-a2ef-6e6393b91bee req-d762a5b9-6b7e-46ec-9764-5275e56b2f31 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-23c694c6-90af-46e1-a2ef-6e6393b91bee req-d762a5b9-6b7e-46ec-9764-5275e56b2f31 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-23c694c6-90af-46e1-a2ef-6e6393b91bee req-d762a5b9-6b7e-46ec-9764-5275e56b2f31 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-23c694c6-90af-46e1-a2ef-6e6393b91bee req-d762a5b9-6b7e-46ec-9764-5275e56b2f31 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:04 user nova-compute[74582]: WARNING nova.compute.manager [req-23c694c6-90af-46e1-a2ef-6e6393b91bee req-d762a5b9-6b7e-46ec-9764-5275e56b2f31 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state rescuing.
Nov 03 14:13:05 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:05 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:13:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-deb4c981-54f3-49ed-aa8b-1808e1c4a84b req-297f8a23-9d2b-4148-bffd-8d7359bcce59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-deb4c981-54f3-49ed-aa8b-1808e1c4a84b req-297f8a23-9d2b-4148-bffd-8d7359bcce59 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-deb4c981-54f3-49ed-aa8b-1808e1c4a84b req-297f8a23-9d2b-4148-bffd-8d7359bcce59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-deb4c981-54f3-49ed-aa8b-1808e1c4a84b req-297f8a23-9d2b-4148-bffd-8d7359bcce59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:07 user nova-compute[74582]: DEBUG nova.compute.manager [req-deb4c981-54f3-49ed-aa8b-1808e1c4a84b req-297f8a23-9d2b-4148-bffd-8d7359bcce59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:07 user nova-compute[74582]: WARNING nova.compute.manager [req-deb4c981-54f3-49ed-aa8b-1808e1c4a84b req-297f8a23-9d2b-4148-bffd-8d7359bcce59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state rescuing.
Nov 03 14:13:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-052b582e-4c8f-465e-b7ed-100d69083e62 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:13:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "339e891c-da3f-46a3-8303-0d88bb770627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:15 user nova-compute[74582]: INFO nova.compute.manager [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Terminating instance
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:13:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance destroyed successfully.
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lazy-loading 'resources' on Instance uuid 339e891c-da3f-46a3-8303-0d88bb770627 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-395639538',display_name='tempest-ServerActionsTestOtherB-server-395639538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-395639538',id=33,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHc9/jbfunoqVsUhLUu1pjLoR0V9zAk2xJMMTcjnRQGzg8BfzopXdOQ8CMQsm/bnvhMZdrP/DcHwcZwnlASxD9QF6FDnyfFwLjY5dKNP3gjQUH+twCkAlnrIC7JY2BNGg==',key_name='tempest-keypair-138063646',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9f304de49fe4b2da95e3ea87508b5f7',ramdisk_id='',reservation_id='r-0ybfq9xk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1210177191',owner_user_name='tempest-ServerActionsTestOtherB-1210177191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2d0bf6ce5845209edecb631b24433d',uuid=339e891c-da3f-46a3-8303-0d88bb770627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converting VIF {"id": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "address": "fa:16:3e:6d:8d:13", "network": {"id": "2767a452-8512-4afe-b1d6-fbb71baf3640", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734693917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f304de49fe4b2da95e3ea87508b5f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6be05a-ae", "ovs_interfaceid": "fe6be05a-ae7a-4022-b40e-faba879bc06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_vif [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe6be05a-ae, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:13:15 user nova-compute[74582]: INFO os_vif [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8d:13,bridge_name='br-int',has_traffic_filtering=True,id=fe6be05a-ae7a-4022-b40e-faba879bc06f,network=Network(2767a452-8512-4afe-b1d6-fbb71baf3640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6be05a-ae')
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMwqEIBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:13:15 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e1e40c-f32c-438f-b87f-cfcdbe697289]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:13:15 user nova-compute[74582]: No targets found.
Nov 03 14:13:15 user nova-compute[74582]: iSNS:
Nov 03 14:13:15 user nova-compute[74582]: No targets found.
Nov 03 14:13:15 user nova-compute[74582]: STATIC:
Nov 03 14:13:15 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4
Nov 03 14:13:15 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:13:15 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:13:15 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae
Nov 03 14:13:15 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:13:15 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:13:15 user nova-compute[74582]: FIRMWARE:
Nov 03 14:13:15 user nova-compute[74582]: No targets found.
Nov 03 14:13:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:13:15 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:13:15 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6956d3d-a1ee-46be-9ed3-d21d39389443', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd55e8-373a-48d4-b85e-236ae0757aff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Skipping network cache update for instance because it is being deleted. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b87b97-d4a4-4378-a6b9-df1a7148ec3a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:13:15 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:13:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:13:15 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:13:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682dd120>, {}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Disconnecting from: [] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.101s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] <== disconnect_volume: return (102ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:13:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deletion of /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize failed
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:15 user nova-compute[74582]: INFO nova.compute.manager [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Took 0.26 seconds to destroy the instance on the hypervisor.
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:13:15 user nova-compute[74582]: INFO nova.compute.claims [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Claim successful on node user
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:13:15 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:13:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.policy [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21a795451e044a8394ff26ca920c44f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72750b673ec946e08a94d8691bfc8e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:13:16 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Took 0.95 seconds to deallocate network for instance.
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-5b951ba7-b0cc-4a9a-a91d-4adc42c08801 req-5c282990-9b33-410d-bf3e-771a428c2cb2 service nova] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Received event network-vif-deleted-fe6be05a-ae7a-4022-b40e-faba879bc06f {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:16 user nova-compute[74582]: INFO nova.compute.manager [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Took 0.08 seconds to detach 1 volumes for instance.
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:13:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Creating image(s)
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "/opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "/opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.195s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk 1073741824" returned: 0 in 0.068s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:17 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Deleted allocations for instance 339e891c-da3f-46a3-8303-0d88bb770627
Nov 03 14:13:17 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Successfully created port: 6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2176f1eb-8f3a-4c03-aff3-f693239a11e2 tempest-ServerActionsTestOtherB-1210177191 tempest-ServerActionsTestOtherB-1210177191-project-member] Lock "339e891c-da3f-46a3-8303-0d88bb770627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.216s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Cannot resize image /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Ensure instance console log exists: /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Successfully updated port: 6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquired lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-changed-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Refreshing instance network info cache due to event network-changed-6e6f006e-e926-4549-88a9-59448981f023. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] Acquiring lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updating instance_info_cache with network_info: [{"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Releasing lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Instance network_info: |[{"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] Acquired lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Refreshing network info cache for port 6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Start _get_guest_xml network_info=[{"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:13:18 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:13:18 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-741409540',display_name='tempest-VolumesSnapshotTestJSON-instance-741409540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-741409540',id=40,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHl5aipNB6WNzuq/QslS23X4mCz9/thF3tWmz4F3o2h6tUlDH0wWfxUOUywau5uPz7RhxqPdSPD4+F9vyKTc/coxp+nGOxNNkfxRAH7mVCpw4M63bSxp73Lg2UUqyN1Vg==',key_name='tempest-keypair-446499307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72750b673ec946e08a94d8691bfc8e83',ramdisk_id='',reservation_id='r-bdvrulv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2065237936',owner_user_name='tempest-VolumesSnapshotTestJSON-2065237936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21a795451e044a8394ff26ca920c44f1',uuid=1c80ef52-7f9d-465e-aeee-1957849fd2d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converting VIF {"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.objects.instance [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:13:18 user nova-compute[74582]:   <uuid>1c80ef52-7f9d-465e-aeee-1957849fd2d9</uuid>
Nov 03 14:13:18 user nova-compute[74582]:   <name>instance-00000028</name>
Nov 03 14:13:18 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:13:18 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:13:18 user nova-compute[74582]:   <metadata>
Nov 03 14:13:18 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:13:18 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:13:18 user nova-compute[74582]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-741409540</nova:name>
Nov 03 14:13:18 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:13:18</nova:creationTime>
Nov 03 14:13:18 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:13:18 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:13:18 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:13:18 user nova-compute[74582]:       <nova:owner>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:user uuid="21a795451e044a8394ff26ca920c44f1">tempest-VolumesSnapshotTestJSON-2065237936-project-member</nova:user>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:project uuid="72750b673ec946e08a94d8691bfc8e83">tempest-VolumesSnapshotTestJSON-2065237936</nova:project>
Nov 03 14:13:18 user nova-compute[74582]:       </nova:owner>
Nov 03 14:13:18 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:13:18 user nova-compute[74582]:       <nova:ports>
Nov 03 14:13:18 user nova-compute[74582]:         <nova:port uuid="6e6f006e-e926-4549-88a9-59448981f023">
Nov 03 14:13:18 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 14:13:18 user nova-compute[74582]:         </nova:port>
Nov 03 14:13:18 user nova-compute[74582]:       </nova:ports>
Nov 03 14:13:18 user nova-compute[74582]:     </nova:instance>
Nov 03 14:13:18 user nova-compute[74582]:   </metadata>
Nov 03 14:13:18 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:13:18 user nova-compute[74582]:     <system>
Nov 03 14:13:18 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:13:18 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:13:18 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:13:18 user nova-compute[74582]:       <entry name="serial">1c80ef52-7f9d-465e-aeee-1957849fd2d9</entry>
Nov 03 14:13:18 user nova-compute[74582]:       <entry name="uuid">1c80ef52-7f9d-465e-aeee-1957849fd2d9</entry>
Nov 03 14:13:18 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:13:18 user nova-compute[74582]:     </system>
Nov 03 14:13:18 user nova-compute[74582]:   </sysinfo>
Nov 03 14:13:18 user nova-compute[74582]:   <os>
Nov 03 14:13:18 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:13:18 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:13:18 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:13:18 user nova-compute[74582]:   </os>
Nov 03 14:13:18 user nova-compute[74582]:   <features>
Nov 03 14:13:18 user nova-compute[74582]:     <acpi/>
Nov 03 14:13:18 user nova-compute[74582]:     <apic/>
Nov 03 14:13:18 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:13:18 user nova-compute[74582]:   </features>
Nov 03 14:13:18 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:13:18 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:13:18 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:13:18 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:13:18 user nova-compute[74582]:   </clock>
Nov 03 14:13:18 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:13:18 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:13:18 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:13:18 user nova-compute[74582]:   </cpu>
Nov 03 14:13:18 user nova-compute[74582]:   <devices>
Nov 03 14:13:18 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:13:18 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:13:18 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk"/>
Nov 03 14:13:18 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:13:18 user nova-compute[74582]:     </disk>
Nov 03 14:13:18 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:13:18 user nova-compute[74582]:       <mac address="fa:16:3e:d5:af:42"/>
Nov 03 14:13:18 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:13:18 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:13:18 user nova-compute[74582]:       <target dev="tap6e6f006e-e9"/>
Nov 03 14:13:18 user nova-compute[74582]:     </interface>
Nov 03 14:13:18 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:13:18 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/console.log" append="off"/>
Nov 03 14:13:18 user nova-compute[74582]:     </serial>
Nov 03 14:13:18 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:13:18 user nova-compute[74582]:     <video>
Nov 03 14:13:18 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:13:18 user nova-compute[74582]:     </video>
Nov 03 14:13:18 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:13:18 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:13:18 user nova-compute[74582]:     </rng>
Nov 03 14:13:18 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:13:18 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:13:18 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:13:18 user nova-compute[74582]:     </memballoon>
Nov 03 14:13:18 user nova-compute[74582]:   </devices>
Nov 03 14:13:18 user nova-compute[74582]: </domain>
Nov 03 14:13:18 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-741409540',display_name='tempest-VolumesSnapshotTestJSON-instance-741409540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-741409540',id=40,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHl5aipNB6WNzuq/QslS23X4mCz9/thF3tWmz4F3o2h6tUlDH0wWfxUOUywau5uPz7RhxqPdSPD4+F9vyKTc/coxp+nGOxNNkfxRAH7mVCpw4M63bSxp73Lg2UUqyN1Vg==',key_name='tempest-keypair-446499307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72750b673ec946e08a94d8691bfc8e83',ramdisk_id='',reservation_id='r-bdvrulv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2065237936',owner_user_name='tempest-VolumesSnapshotTestJSON-2065237936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21a795451e044a8394ff26ca920c44f1',uuid=1c80ef52-7f9d-465e-aeee-1957849fd2d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converting VIF {"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG os_vif [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4477f110-55b0-5154-8fb2-64f8946d3bed', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e6f006e-e9, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e6f006e-e9, col_values=(('qos', UUID('d9d36f5a-ea70-4b2b-b4c4-8f1f594690c9')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e6f006e-e9, col_values=(('external_ids', {'iface-id': '6e6f006e-e926-4549-88a9-59448981f023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:af:42', 'vm-uuid': '1c80ef52-7f9d-465e-aeee-1957849fd2d9'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:18 user nova-compute[74582]: INFO os_vif [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9')
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No VIF found with MAC fa:16:3e:d5:af:42, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updated VIF entry in instance network info cache for port 6e6f006e-e926-4549-88a9-59448981f023. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG nova.network.neutron [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updating instance_info_cache with network_info: [{"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-55a7b440-812a-4764-bd1b-0b538c424bde req-ede637cc-561b-4269-9252-cc545d4b6ba2 service nova] Releasing lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-2f8c1c95-d4b6-4ffc-8b5f-1e719b76f5bc req-0229cbba-e006-446c-9ab3-25642d59e0c5 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2f8c1c95-d4b6-4ffc-8b5f-1e719b76f5bc req-0229cbba-e006-446c-9ab3-25642d59e0c5 service nova] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2f8c1c95-d4b6-4ffc-8b5f-1e719b76f5bc req-0229cbba-e006-446c-9ab3-25642d59e0c5 service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2f8c1c95-d4b6-4ffc-8b5f-1e719b76f5bc req-0229cbba-e006-446c-9ab3-25642d59e0c5 service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-2f8c1c95-d4b6-4ffc-8b5f-1e719b76f5bc req-0229cbba-e006-446c-9ab3-25642d59e0c5 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] No waiting events found dispatching network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:20 user nova-compute[74582]: WARNING nova.compute.manager [req-2f8c1c95-d4b6-4ffc-8b5f-1e719b76f5bc req-0229cbba-e006-446c-9ab3-25642d59e0c5 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received unexpected event network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 for instance with vm_state building and task_state spawning.
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:13:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Instance spawned successfully.
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:22 user nova-compute[74582]: INFO nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-2aedf104-6517-45c1-ad8f-02695d43faa3 req-f50c42cc-15a8-421f-a61b-fac1ff16b3aa service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2aedf104-6517-45c1-ad8f-02695d43faa3 req-f50c42cc-15a8-421f-a61b-fac1ff16b3aa service nova] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2aedf104-6517-45c1-ad8f-02695d43faa3 req-f50c42cc-15a8-421f-a61b-fac1ff16b3aa service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2aedf104-6517-45c1-ad8f-02695d43faa3 req-f50c42cc-15a8-421f-a61b-fac1ff16b3aa service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-2aedf104-6517-45c1-ad8f-02695d43faa3 req-f50c42cc-15a8-421f-a61b-fac1ff16b3aa service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] No waiting events found dispatching network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:22 user nova-compute[74582]: WARNING nova.compute.manager [req-2aedf104-6517-45c1-ad8f-02695d43faa3 req-f50c42cc-15a8-421f-a61b-fac1ff16b3aa service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received unexpected event network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 for instance with vm_state building and task_state spawning.
Nov 03 14:13:22 user nova-compute[74582]: INFO nova.compute.manager [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Took 6.81 seconds to build instance.
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-1abb8854-35de-4195-a589-790c5b09e03c tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.955s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:13:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:13:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:13:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=24.927040100097656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 8f30eb65-1553-4f18-a861-b97e58dda769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 50562940-704d-4c03-a99e-c1e94dc6559e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:13:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-changed-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG nova.compute.manager [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Refreshing instance network info cache due to event network-changed-4a0d26f3-2c5f-4e94-945c-89ef74798cba. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] Acquiring lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] Acquired lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG nova.network.neutron [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Refreshing network info cache for port 4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:30 user nova-compute[74582]: INFO nova.compute.manager [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Terminating instance
Nov 03 14:13:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG nova.network.neutron [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updated VIF entry in instance network info cache for port 4a0d26f3-2c5f-4e94-945c-89ef74798cba. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG nova.network.neutron [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating instance_info_cache with network_info: [{"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-77e357f1-e208-4fce-93a1-b4771c9731e3 req-029681b2-3d1d-42b8-aa2e-157fe4ab8055 service nova] Releasing lock "refresh_cache-8f30eb65-1553-4f18-a861-b97e58dda769" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-e46b1ba1-6193-43eb-85a1-5c0e64714db1 req-15bcc9f6-eea8-42b7-8afd-17ec1155c8b0 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-vif-unplugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e46b1ba1-6193-43eb-85a1-5c0e64714db1 req-15bcc9f6-eea8-42b7-8afd-17ec1155c8b0 service nova] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e46b1ba1-6193-43eb-85a1-5c0e64714db1 req-15bcc9f6-eea8-42b7-8afd-17ec1155c8b0 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e46b1ba1-6193-43eb-85a1-5c0e64714db1 req-15bcc9f6-eea8-42b7-8afd-17ec1155c8b0 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-e46b1ba1-6193-43eb-85a1-5c0e64714db1 req-15bcc9f6-eea8-42b7-8afd-17ec1155c8b0 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] No waiting events found dispatching network-vif-unplugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-e46b1ba1-6193-43eb-85a1-5c0e64714db1 req-15bcc9f6-eea8-42b7-8afd-17ec1155c8b0 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-vif-unplugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:13:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Instance destroyed successfully.
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.objects.instance [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lazy-loading 'resources' on Instance uuid 8f30eb65-1553-4f18-a861-b97e58dda769 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-86748892',display_name='tempest-TestStampPattern-server-86748892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-86748892',id=32,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtb8RAC35Ay0NuOoY0sqUucIv1xSQ5rEt2guSpAdeXJNP1NDaO8I8qlX3itFFRV8dIepDCZk1yyH9FZ6lG5GcbOOfXTSmewWSLa+X/BsbXndkr4Ujjx09AOtfXavppNwg==',key_name='tempest-TestStampPattern-1127467608',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77a5c94d1094e269259d0b6037319aa',ramdisk_id='',reservation_id='r-vza2d6fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-722996733',owner_user_name='tempest-TestStampPattern-722996733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:09:06Z,user_data=None,user_id='db5774b6cb564ba98174b4cf04888359',uuid=8f30eb65-1553-4f18-a861-b97e58dda769,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converting VIF {"id": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "address": "fa:16:3e:f6:33:2b", "network": {"id": "09ef809c-ac14-4a52-a82c-66e813392e42", "bridge": "br-int", "label": "tempest-TestStampPattern-689566985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a5c94d1094e269259d0b6037319aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0d26f3-2c", "ovs_interfaceid": "4a0d26f3-2c5f-4e94-945c-89ef74798cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG os_vif [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a0d26f3-2c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=871ca5bb-083b-4ed3-8adf-20b2f3619016) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:31 user nova-compute[74582]: INFO os_vif [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:33:2b,bridge_name='br-int',has_traffic_filtering=True,id=4a0d26f3-2c5f-4e94-945c-89ef74798cba,network=Network(09ef809c-ac14-4a52-a82c-66e813392e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0d26f3-2c')
Nov 03 14:13:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Deleting instance files /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769_del
Nov 03 14:13:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Deletion of /opt/stack/data/nova/instances/8f30eb65-1553-4f18-a861-b97e58dda769_del complete
Nov 03 14:13:31 user nova-compute[74582]: INFO nova.compute.manager [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 03 14:13:31 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:31 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Took 0.47 seconds to deallocate network for instance.
Nov 03 14:13:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:32 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:13:32 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:13:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:32 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Deleted allocations for instance 8f30eb65-1553-4f18-a861-b97e58dda769
Nov 03 14:13:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-fd3c3bb4-d9cf-43bc-9d79-ed1c2690c1f8 tempest-TestStampPattern-722996733 tempest-TestStampPattern-722996733-project-member] Lock "8f30eb65-1553-4f18-a861-b97e58dda769" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:32 user nova-compute[74582]: DEBUG nova.compute.manager [req-0be2cbb1-758d-4c7a-bf99-c49ebc6881b7 req-632957ab-03ab-4cf8-adcc-2f50942301a3 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-vif-deleted-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-7ab2246c-88e9-4eea-b20e-d1a440798f86 req-a9ac0ec8-9468-497b-af00-c5123fc91140 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received event network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7ab2246c-88e9-4eea-b20e-d1a440798f86 req-a9ac0ec8-9468-497b-af00-c5123fc91140 service nova] Acquiring lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7ab2246c-88e9-4eea-b20e-d1a440798f86 req-a9ac0ec8-9468-497b-af00-c5123fc91140 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7ab2246c-88e9-4eea-b20e-d1a440798f86 req-a9ac0ec8-9468-497b-af00-c5123fc91140 service nova] Lock "8f30eb65-1553-4f18-a861-b97e58dda769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-7ab2246c-88e9-4eea-b20e-d1a440798f86 req-a9ac0ec8-9468-497b-af00-c5123fc91140 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] No waiting events found dispatching network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:13:33 user nova-compute[74582]: WARNING nova.compute.manager [req-7ab2246c-88e9-4eea-b20e-d1a440798f86 req-a9ac0ec8-9468-497b-af00-c5123fc91140 service nova] [instance: 8f30eb65-1553-4f18-a861-b97e58dda769] Received unexpected event network-vif-plugged-4a0d26f3-2c5f-4e94-945c-89ef74798cba for instance with vm_state deleted and task_state None.
Nov 03 14:13:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:13:41 user nova-compute[74582]: WARNING nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Nov 03 14:13:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid c872e44a-e815-4f43-bbea-867d7a189c2e {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:13:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing instance network info cache due to event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updated VIF entry in instance network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d47ee3f0-7137-45f6-a39c-0ceecd84c22a req-f4cc98d4-c878-4c03-be21-40f867d0be24 service nova] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing instance network info cache due to event network-changed-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Refreshing network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:13:57 user nova-compute[74582]: INFO nova.compute.manager [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Detaching volume 64b0399f-2d2a-460f-8095-a504d2ae44ae
Nov 03 14:13:57 user nova-compute[74582]: INFO nova.virt.block_device [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Attempting to driver detach volume 64b0399f-2d2a-460f-8095-a504d2ae44ae from mountpoint /dev/vdb
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Attempting to detach device vdb from instance 50562940-704d-4c03-a99e-c1e94dc6559e from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:13:57 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:13:57 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:13:57 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:13:57 user nova-compute[74582]:   <serial>64b0399f-2d2a-460f-8095-a504d2ae44ae</serial>
Nov 03 14:13:57 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:13:57 user nova-compute[74582]: </disk>
Nov 03 14:13:57 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:13:57 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully detached device vdb from instance 50562940-704d-4c03-a99e-c1e94dc6559e from the persistent domain config.
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50562940-704d-4c03-a99e-c1e94dc6559e from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:13:57 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:13:57 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:13:57 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:13:57 user nova-compute[74582]:   <serial>64b0399f-2d2a-460f-8095-a504d2ae44ae</serial>
Nov 03 14:13:57 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:13:57 user nova-compute[74582]: </disk>
Nov 03 14:13:57 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updated VIF entry in instance network info cache for port 00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f8827275-5394-4794-a9f9-6ed3cc1b90cc req-225702e4-5917-460a-be69-7c22806a1d92 service nova] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:13:57 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:14:00 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:02 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:03 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:14:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [{"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-50562940-704d-4c03-a99e-c1e94dc6559e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:17 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50562940-704d-4c03-a99e-c1e94dc6559e is timed out.
Nov 03 14:14:17 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully detached device vdb from instance 50562940-704d-4c03-a99e-c1e94dc6559e from the live domain config.
Nov 03 14:14:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fICBELAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:14:17 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bacfb90-3225-4722-94d5-8d51e77dbef4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cab4131c-a398-407e-9397-3bd07c31aa6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:14:17 user nova-compute[74582]: No targets found.
Nov 03 14:14:17 user nova-compute[74582]: iSNS:
Nov 03 14:14:17 user nova-compute[74582]: No targets found.
Nov 03 14:14:17 user nova-compute[74582]: STATIC:
Nov 03 14:14:17 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:cab4131c-a398-407e-9397-3bd07c31aa6c
Nov 03 14:14:17 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:14:17 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:14:17 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4
Nov 03 14:14:17 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:14:17 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:14:17 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae
Nov 03 14:14:17 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:14:17 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:14:17 user nova-compute[74582]: FIRMWARE:
Nov 03 14:14:17 user nova-compute[74582]: No targets found.
Nov 03 14:14:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:14:17 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:14:17 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[015918b7-6659-4af2-afd6-5ad612c9cf6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cab4131c-a398-407e-9397-3bd07c31aa6c\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8257d8b-e53f-45a3-b45e-7baf5a13d973]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4131c-a398-407e-9397-3bd07c31aa6c (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:14:17 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:14:17 user nova-compute[74582]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4131c-a398-407e-9397-3bd07c31aa6c (non-flash)
Nov 03 14:14:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae (non-flash)
Nov 03 14:14:17 user nova-compute[74582]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:14:17 user nova-compute[74582]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4131c-a398-407e-9397-3bd07c31aa6c (non-flash)
Nov 03 14:14:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f68366f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8adf482-4f5a-411d-9074-513ecbb60b48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f684658-41a7-4959-96ed-b88638661204]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:14:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b937208-8865-4fa0-aab2-e72dde6e206b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aabb041-b95e-4002-8e4b-83273a67bce7]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0528536-0b14-44c2-ad2f-2d2eb6181cd8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954f378-d891-4a72-bb94-537b963bdd58]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260]
Nov 03 14:14:18 user nova-compute[74582]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae, portal: 172.16.0.220,3260] successful.
Nov 03 14:14:18 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b0399f-2d2a-460f-8095-a504d2ae44ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dfeb22-0af5-4e0b-bc7e-822efb7a870b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] <== disconnect_volume: return (391ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:14:18 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:14:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'flavor' on Instance uuid 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:14:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-b2b091ab-0cf6-43ed-8229-0f96086b4473 tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.182s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:14:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:14:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=23.915477752685547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 50562940-704d-4c03-a99e-c1e94dc6559e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:14:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:14:30 user nova-compute[74582]: INFO nova.compute.claims [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Claim successful on node user
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:14:30 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.policy [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cb25ef9de143a5a55d341a089e19de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f3f5290550c487fa7c35f987312a79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:14:30 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Creating image(s)
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9658a040-77d8-45da-bb65-930ee5466b1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:14:31 user nova-compute[74582]: INFO nova.compute.claims [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Claim successful on node user
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Successfully created port: 499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk 1073741824" returned: 0 in 0.059s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.225s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:14:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Cannot resize image /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Ensure instance console log exists: /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.policy [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cb25ef9de143a5a55d341a089e19de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f3f5290550c487fa7c35f987312a79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:14:31 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Creating image(s)
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.218s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Successfully updated port: 499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.compute.manager [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-changed-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.compute.manager [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Refreshing instance network info cache due to event network-changed-499a267b-a845-4b95-8cbd-f6e718a553d6. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.223s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk 1073741824" returned: 0 in 0.059s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Successfully created port: 6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance network_info: |[{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.neutron [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Refreshing network info cache for port 499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Start _get_guest_xml network_info=[{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:14:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:14:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1500254791',display_name='tempest-ServerRescueNegativeTestJSON-server-1500254791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1500254791',id=41,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-4hil07kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:14:31Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=689c409d-9f60-4ad1-b9c1-5386c7a1bf8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'pci_devices' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:14:32 user nova-compute[74582]:   <uuid>689c409d-9f60-4ad1-b9c1-5386c7a1bf8e</uuid>
Nov 03 14:14:32 user nova-compute[74582]:   <name>instance-00000029</name>
Nov 03 14:14:32 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:14:32 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:14:32 user nova-compute[74582]:   <metadata>
Nov 03 14:14:32 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:14:32 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:14:32 user nova-compute[74582]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1500254791</nova:name>
Nov 03 14:14:32 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:14:32</nova:creationTime>
Nov 03 14:14:32 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:14:32 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:14:32 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:14:32 user nova-compute[74582]:       <nova:owner>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:user uuid="86cb25ef9de143a5a55d341a089e19de">tempest-ServerRescueNegativeTestJSON-1868952631-project-member</nova:user>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:project uuid="9f3f5290550c487fa7c35f987312a79b">tempest-ServerRescueNegativeTestJSON-1868952631</nova:project>
Nov 03 14:14:32 user nova-compute[74582]:       </nova:owner>
Nov 03 14:14:32 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:14:32 user nova-compute[74582]:       <nova:ports>
Nov 03 14:14:32 user nova-compute[74582]:         <nova:port uuid="499a267b-a845-4b95-8cbd-f6e718a553d6">
Nov 03 14:14:32 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 14:14:32 user nova-compute[74582]:         </nova:port>
Nov 03 14:14:32 user nova-compute[74582]:       </nova:ports>
Nov 03 14:14:32 user nova-compute[74582]:     </nova:instance>
Nov 03 14:14:32 user nova-compute[74582]:   </metadata>
Nov 03 14:14:32 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:14:32 user nova-compute[74582]:     <system>
Nov 03 14:14:32 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:14:32 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:14:32 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:14:32 user nova-compute[74582]:       <entry name="serial">689c409d-9f60-4ad1-b9c1-5386c7a1bf8e</entry>
Nov 03 14:14:32 user nova-compute[74582]:       <entry name="uuid">689c409d-9f60-4ad1-b9c1-5386c7a1bf8e</entry>
Nov 03 14:14:32 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:14:32 user nova-compute[74582]:     </system>
Nov 03 14:14:32 user nova-compute[74582]:   </sysinfo>
Nov 03 14:14:32 user nova-compute[74582]:   <os>
Nov 03 14:14:32 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:14:32 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:14:32 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:14:32 user nova-compute[74582]:   </os>
Nov 03 14:14:32 user nova-compute[74582]:   <features>
Nov 03 14:14:32 user nova-compute[74582]:     <acpi/>
Nov 03 14:14:32 user nova-compute[74582]:     <apic/>
Nov 03 14:14:32 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:14:32 user nova-compute[74582]:   </features>
Nov 03 14:14:32 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:14:32 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:14:32 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:14:32 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:14:32 user nova-compute[74582]:   </clock>
Nov 03 14:14:32 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:14:32 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:14:32 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:14:32 user nova-compute[74582]:   </cpu>
Nov 03 14:14:32 user nova-compute[74582]:   <devices>
Nov 03 14:14:32 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:14:32 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:14:32 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk"/>
Nov 03 14:14:32 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:14:32 user nova-compute[74582]:     </disk>
Nov 03 14:14:32 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:14:32 user nova-compute[74582]:       <mac address="fa:16:3e:0d:35:54"/>
Nov 03 14:14:32 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:14:32 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:14:32 user nova-compute[74582]:       <target dev="tap499a267b-a8"/>
Nov 03 14:14:32 user nova-compute[74582]:     </interface>
Nov 03 14:14:32 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:14:32 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/console.log" append="off"/>
Nov 03 14:14:32 user nova-compute[74582]:     </serial>
Nov 03 14:14:32 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:14:32 user nova-compute[74582]:     <video>
Nov 03 14:14:32 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:14:32 user nova-compute[74582]:     </video>
Nov 03 14:14:32 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:14:32 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:14:32 user nova-compute[74582]:     </rng>
Nov 03 14:14:32 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:14:32 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:14:32 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:14:32 user nova-compute[74582]:     </memballoon>
Nov 03 14:14:32 user nova-compute[74582]:   </devices>
Nov 03 14:14:32 user nova-compute[74582]: </domain>
Nov 03 14:14:32 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1500254791',display_name='tempest-ServerRescueNegativeTestJSON-server-1500254791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1500254791',id=41,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-4hil07kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:14:31Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=689c409d-9f60-4ad1-b9c1-5386c7a1bf8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG os_vif [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fca5886-2d0b-5c73-9595-f16f22252742', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap499a267b-a8, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap499a267b-a8, col_values=(('qos', UUID('fee5e657-6fce-4efb-bc38-702658b054b8')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap499a267b-a8, col_values=(('external_ids', {'iface-id': '499a267b-a845-4b95-8cbd-f6e718a553d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:35:54', 'vm-uuid': '689c409d-9f60-4ad1-b9c1-5386c7a1bf8e'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Cannot resize image /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Ensure instance console log exists: /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:32 user nova-compute[74582]: INFO os_vif [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8')
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:14:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:0d:35:54, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updated VIF entry in instance network info cache for port 499a267b-a845-4b95-8cbd-f6e718a553d6. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0980fe56-6fa2-4ed5-b1b6-02912266f4a8 req-1db57632-3e2f-47bc-8d0d-ca86e00c810f service nova] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Successfully updated port: 6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-changed-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.compute.manager [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Refreshing instance network info cache due to event network-changed-6a67faf6-cb27-45cf-8561-6a54e3d320ad. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] Acquiring lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance network_info: |[{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] Acquired lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.neutron [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Refreshing network info cache for port 6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Start _get_guest_xml network_info=[{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:14:33 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:14:33 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015289643',display_name='tempest-ServerRescueNegativeTestJSON-server-2015289643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015289643',id=42,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-2n17jzb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:14:32Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=9658a040-77d8-45da-bb65-930ee5466b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'pci_devices' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:14:33 user nova-compute[74582]:   <uuid>9658a040-77d8-45da-bb65-930ee5466b1c</uuid>
Nov 03 14:14:33 user nova-compute[74582]:   <name>instance-0000002a</name>
Nov 03 14:14:33 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:14:33 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:14:33 user nova-compute[74582]:   <metadata>
Nov 03 14:14:33 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:14:33 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:14:33 user nova-compute[74582]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2015289643</nova:name>
Nov 03 14:14:33 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:14:33</nova:creationTime>
Nov 03 14:14:33 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:14:33 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:14:33 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:14:33 user nova-compute[74582]:       <nova:owner>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:user uuid="86cb25ef9de143a5a55d341a089e19de">tempest-ServerRescueNegativeTestJSON-1868952631-project-member</nova:user>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:project uuid="9f3f5290550c487fa7c35f987312a79b">tempest-ServerRescueNegativeTestJSON-1868952631</nova:project>
Nov 03 14:14:33 user nova-compute[74582]:       </nova:owner>
Nov 03 14:14:33 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:14:33 user nova-compute[74582]:       <nova:ports>
Nov 03 14:14:33 user nova-compute[74582]:         <nova:port uuid="6a67faf6-cb27-45cf-8561-6a54e3d320ad">
Nov 03 14:14:33 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 14:14:33 user nova-compute[74582]:         </nova:port>
Nov 03 14:14:33 user nova-compute[74582]:       </nova:ports>
Nov 03 14:14:33 user nova-compute[74582]:     </nova:instance>
Nov 03 14:14:33 user nova-compute[74582]:   </metadata>
Nov 03 14:14:33 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:14:33 user nova-compute[74582]:     <system>
Nov 03 14:14:33 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:14:33 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:14:33 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:14:33 user nova-compute[74582]:       <entry name="serial">9658a040-77d8-45da-bb65-930ee5466b1c</entry>
Nov 03 14:14:33 user nova-compute[74582]:       <entry name="uuid">9658a040-77d8-45da-bb65-930ee5466b1c</entry>
Nov 03 14:14:33 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:14:33 user nova-compute[74582]:     </system>
Nov 03 14:14:33 user nova-compute[74582]:   </sysinfo>
Nov 03 14:14:33 user nova-compute[74582]:   <os>
Nov 03 14:14:33 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:14:33 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:14:33 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:14:33 user nova-compute[74582]:   </os>
Nov 03 14:14:33 user nova-compute[74582]:   <features>
Nov 03 14:14:33 user nova-compute[74582]:     <acpi/>
Nov 03 14:14:33 user nova-compute[74582]:     <apic/>
Nov 03 14:14:33 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:14:33 user nova-compute[74582]:   </features>
Nov 03 14:14:33 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:14:33 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:14:33 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:14:33 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:14:33 user nova-compute[74582]:   </clock>
Nov 03 14:14:33 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:14:33 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:14:33 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:14:33 user nova-compute[74582]:   </cpu>
Nov 03 14:14:33 user nova-compute[74582]:   <devices>
Nov 03 14:14:33 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:14:33 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:14:33 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk"/>
Nov 03 14:14:33 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:14:33 user nova-compute[74582]:     </disk>
Nov 03 14:14:33 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:14:33 user nova-compute[74582]:       <mac address="fa:16:3e:54:d3:74"/>
Nov 03 14:14:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:14:33 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:14:33 user nova-compute[74582]:       <target dev="tap6a67faf6-cb"/>
Nov 03 14:14:33 user nova-compute[74582]:     </interface>
Nov 03 14:14:33 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:14:33 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/console.log" append="off"/>
Nov 03 14:14:33 user nova-compute[74582]:     </serial>
Nov 03 14:14:33 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:14:33 user nova-compute[74582]:     <video>
Nov 03 14:14:33 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:14:33 user nova-compute[74582]:     </video>
Nov 03 14:14:33 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:14:33 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:14:33 user nova-compute[74582]:     </rng>
Nov 03 14:14:33 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:14:33 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:14:33 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:14:33 user nova-compute[74582]:     </memballoon>
Nov 03 14:14:33 user nova-compute[74582]:   </devices>
Nov 03 14:14:33 user nova-compute[74582]: </domain>
Nov 03 14:14:33 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015289643',display_name='tempest-ServerRescueNegativeTestJSON-server-2015289643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015289643',id=42,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-2n17jzb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:14:32Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=9658a040-77d8-45da-bb65-930ee5466b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG os_vif [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '637f5886-4888-506e-9bd5-c2b58eeeadf3', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a67faf6-cb, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a67faf6-cb, col_values=(('qos', UUID('c694b171-92d7-4430-abac-1e1c94eccbe9')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a67faf6-cb, col_values=(('external_ids', {'iface-id': '6a67faf6-cb27-45cf-8561-6a54e3d320ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:d3:74', 'vm-uuid': '9658a040-77d8-45da-bb65-930ee5466b1c'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:33 user nova-compute[74582]: INFO os_vif [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb')
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:14:33 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:54:d3:74, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG nova.network.neutron [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updated VIF entry in instance network info cache for port 6a67faf6-cb27-45cf-8561-6a54e3d320ad. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG nova.network.neutron [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-62c11e7f-3249-4c33-b39d-c18b4d3462a8 req-ba2c2c3b-e9fb-4c2c-8a3e-cc61fb8f7bed service nova] Releasing lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:35 user nova-compute[74582]: WARNING nova.compute.manager [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state building and task_state spawning.
Nov 03 14:14:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG nova.compute.manager [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:35 user nova-compute[74582]: WARNING nova.compute.manager [req-448690a5-6fb8-43f1-89eb-29a65261261d req-4b87676f-7173-4128-b1a3-54652bd2ff8f service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state building and task_state spawning.
Nov 03 14:14:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:37 user nova-compute[74582]: WARNING nova.compute.manager [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state building and task_state spawning.
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.compute.manager [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:37 user nova-compute[74582]: WARNING nova.compute.manager [req-164e7faf-2afb-42ac-81c4-119eb8b29482 req-9481cbe7-fcd2-4db8-88d2-4bb5fc7b8682 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state building and task_state spawning.
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:14:37 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:14:38 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance spawned successfully.
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:14:38 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance spawned successfully.
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:14:38 user nova-compute[74582]: INFO nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:14:38 user nova-compute[74582]: INFO nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 03 14:14:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:14:38 user nova-compute[74582]: INFO nova.compute.manager [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Took 7.18 seconds to build instance.
Nov 03 14:14:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d73d065a-0300-4b61-8d5d-1ea85a237363 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9658a040-77d8-45da-bb65-930ee5466b1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:38 user nova-compute[74582]: INFO nova.compute.manager [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Took 8.10 seconds to build instance.
Nov 03 14:14:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9dde0fe0-8dca-453e-8dd5-3409fe076a7f tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.333s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:50 user nova-compute[74582]: INFO nova.compute.manager [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Unrescuing
Nov 03 14:14:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'flavor' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG nova.compute.manager [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing instance network info cache due to event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG nova.network.neutron [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:14:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance destroyed successfully.
Nov 03 14:14:52 user nova-compute[74582]: DEBUG nova.network.neutron [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updated VIF entry in instance network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG nova.network.neutron [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8eadf8b6-c561-40f4-99b0-296764644679 req-b9cbd3d2-9f36-4797-89c1-932f3f2895f9 service nova] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG nova.compute.manager [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing instance network info cache due to event network-changed-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] Acquiring lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] Acquired lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG nova.network.neutron [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Refreshing network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG nova.network.neutron [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updated VIF entry in instance network info cache for port 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG nova.network.neutron [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [{"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:14:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-58909bc2-b83a-4a27-b2df-2194d36d8cc1 req-da3f0d78-25f1-45e1-83ad-ea5183d04bb8 service nova] Releasing lock "refresh_cache-d62d7210-0ba4-4224-887b-ec3266072bb0" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:14:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-6e81aaee-f735-4f4f-abeb-37b113af75f7 tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:14:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-a82ccbb1-3eeb-4733-bd16-30b7ec7a2b11 req-0ec6d976-5100-4cf4-a56f-2f82470c5570 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a82ccbb1-3eeb-4733-bd16-30b7ec7a2b11 req-0ec6d976-5100-4cf4-a56f-2f82470c5570 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a82ccbb1-3eeb-4733-bd16-30b7ec7a2b11 req-0ec6d976-5100-4cf4-a56f-2f82470c5570 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a82ccbb1-3eeb-4733-bd16-30b7ec7a2b11 req-0ec6d976-5100-4cf4-a56f-2f82470c5570 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-a82ccbb1-3eeb-4733-bd16-30b7ec7a2b11 req-0ec6d976-5100-4cf4-a56f-2f82470c5570 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:56 user nova-compute[74582]: WARNING nova.compute.manager [req-a82ccbb1-3eeb-4733-bd16-30b7ec7a2b11 req-0ec6d976-5100-4cf4-a56f-2f82470c5570 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:14:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:58 user nova-compute[74582]: WARNING nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state None.
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:58 user nova-compute[74582]: WARNING nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state None.
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:58 user nova-compute[74582]: WARNING nova.compute.manager [req-a3a19f74-edbb-4f15-943b-ebe535e99a69 req-befb2df6-219b-494a-9e92-6e61fb9e1a59 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state active and task_state None.
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:58 user nova-compute[74582]: INFO nova.compute.manager [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Terminating instance
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-6c5f9dc1-afd0-4e39-a7e5-aa3811fbf06e req-f3e7a3b3-9c20-45a2-9ce8-c3e07efae088 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-unplugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6c5f9dc1-afd0-4e39-a7e5-aa3811fbf06e req-f3e7a3b3-9c20-45a2-9ce8-c3e07efae088 service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6c5f9dc1-afd0-4e39-a7e5-aa3811fbf06e req-f3e7a3b3-9c20-45a2-9ce8-c3e07efae088 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6c5f9dc1-afd0-4e39-a7e5-aa3811fbf06e req-f3e7a3b3-9c20-45a2-9ce8-c3e07efae088 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-6c5f9dc1-afd0-4e39-a7e5-aa3811fbf06e req-f3e7a3b3-9c20-45a2-9ce8-c3e07efae088 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-unplugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:14:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-6c5f9dc1-afd0-4e39-a7e5-aa3811fbf06e req-f3e7a3b3-9c20-45a2-9ce8-c3e07efae088 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-unplugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:14:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Instance destroyed successfully.
Nov 03 14:14:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lazy-loading 'resources' on Instance uuid 50562940-704d-4c03-a99e-c1e94dc6559e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1466795447',display_name='tempest-TestMinimumBasicScenario-server-1466795447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1466795447',id=38,image_ref='289b1642-2528-4adc-a967-7823945c1656',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInA/cl55XiSIxj25mlIYcdOcTjxCm9mgBBBNZpwaMM6j1NRoHTzbQJiGI5IVP9BD8a+coK1jbX5ezUEcmnEGvruDtuMcjvhNsRVv9xiddRJZLK7ztgh10QCpy2HzQ6sAA==',key_name='tempest-TestMinimumBasicScenario-1647796206',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9069ac678f934449beb0ae6adf96911e',ramdisk_id='',reservation_id='r-ybb4vbq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='289b1642-2528-4adc-a967-7823945c1656',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1621292284',owner_user_name='tempest-TestMinimumBasicScenario-1621292284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:12:12Z,user_data=None,user_id='d63da82cd28e43849a1c8d8572385bf7',uuid=50562940-704d-4c03-a99e-c1e94dc6559e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converting VIF {"id": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "address": "fa:16:3e:df:26:a2", "network": {"id": "b63671e5-1b26-429a-bcce-f41cd43cd6ff", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-157520918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9069ac678f934449beb0ae6adf96911e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c51aa8-2b", "ovs_interfaceid": "00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG os_vif [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00c51aa8-2b, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16487c07-7595-434d-9e4a-95dba0e93edc) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:14:59 user nova-compute[74582]: INFO os_vif [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa,network=Network(b63671e5-1b26-429a-bcce-f41cd43cd6ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c51aa8-2b')
Nov 03 14:14:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Deleting instance files /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e_del
Nov 03 14:14:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Deletion of /opt/stack/data/nova/instances/50562940-704d-4c03-a99e-c1e94dc6559e_del complete
Nov 03 14:14:59 user nova-compute[74582]: INFO nova.compute.manager [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 03 14:14:59 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:14:59 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:15:00 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:15:00 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Took 0.52 seconds to deallocate network for instance.
Nov 03 14:15:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:00 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:15:00 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:15:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:00 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Deleted allocations for instance 50562940-704d-4c03-a99e-c1e94dc6559e
Nov 03 14:15:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-27c9aa9f-0b8e-4028-a33c-0eecf3e947bc tempest-TestMinimumBasicScenario-1621292284 tempest-TestMinimumBasicScenario-1621292284-project-member] Lock "50562940-704d-4c03-a99e-c1e94dc6559e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:15:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] Acquiring lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] Lock "50562940-704d-4c03-a99e-c1e94dc6559e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] No waiting events found dispatching network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:15:01 user nova-compute[74582]: WARNING nova.compute.manager [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received unexpected event network-vif-plugged-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa for instance with vm_state deleted and task_state None.
Nov 03 14:15:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-ba3ddd60-ea56-419d-8a0b-e9d94e6d51f9 req-a5ac2c99-6c63-41e2-b2bb-8641b999e587 service nova] [instance: 50562940-704d-4c03-a99e-c1e94dc6559e] Received event network-vif-deleted-00c51aa8-2b2c-47bf-af3c-c3f7d2a1a0aa {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:15:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:05 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-changed-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Refreshing instance network info cache due to event network-changed-6e6f006e-e926-4549-88a9-59448981f023. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] Acquiring lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] Acquired lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG nova.network.neutron [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Refreshing network info cache for port 6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'flavor' on Instance uuid 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:15:06 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Ignoring supplied device name: /dev/vdb
Nov 03 14:15:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG nova.network.neutron [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updated VIF entry in instance network info cache for port 6e6f006e-e926-4549-88a9-59448981f023. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG nova.network.neutron [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updating instance_info_cache with network_info: [{"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:15:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d591c001-8911-48e1-91af-a69fa0a2069c req-251981a9-5315-452d-ab58-6aaaee8ec66a service nova] Releasing lock "refresh_cache-1c80ef52-7f9d-465e-aeee-1957849fd2d9" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:07 user nova-compute[74582]: INFO nova.compute.manager [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Attaching volume ef73c388-0641-4153-be41-e69598d674b4 to /dev/vdb
Nov 03 14:15:07 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da84b7-924b-482d-bac2-a2e3a2fdfe25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a51675-fdfd-48ac-b7bd-368f74d9acc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54732664-e2f2-4788-8889-66e97936fb5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[65277a28-9e85-47a4-b381-5ff2653bae55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:15:07 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c5e73c-28ba-41bd-8fa5-4409756cafb9]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG os_brick.utils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updating existing volume attachment record: dcee1f65-f55f-4a0e-a747-c2b3146d91e3 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:15:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [{"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-c872e44a-e815-4f43-bbea-867d7a189c2e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:15:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:15:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "121a9119-b669-46f8-94e1-2336a2af437d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:15:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8195MB free_disk=24.87397003173828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d62d7210-0ba4-4224-887b-ec3266072bb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 121a9119-b669-46f8-94e1-2336a2af437d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:15:22 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.302s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:15:23 user nova-compute[74582]: INFO nova.compute.claims [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Claim successful on node user
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:15:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:15:23 user nova-compute[74582]: INFO nova.virt.block_device [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Booting with volume snapshot 645fbb3d-ef6f-4a08-9dde-26b67d8ce83b at /dev/vda
Nov 03 14:15:23 user nova-compute[74582]: DEBUG nova.policy [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c726e17f780a483b8b3a220dfc34125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333545c5c61843ac89215bcc49b520e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:24 user nova-compute[74582]: INFO nova.compute.manager [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Detaching volume 5c6ccf9c-2ee4-4277-a510-1245b1390ff4
Nov 03 14:15:24 user nova-compute[74582]: INFO nova.virt.block_device [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Attempting to driver detach volume 5c6ccf9c-2ee4-4277-a510-1245b1390ff4 from mountpoint /dev/vdb
Nov 03 14:15:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Attempting to detach device vdb from instance d62d7210-0ba4-4224-887b-ec3266072bb0 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:15:24 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:15:24 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:15:24 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:15:24 user nova-compute[74582]:   <serial>5c6ccf9c-2ee4-4277-a510-1245b1390ff4</serial>
Nov 03 14:15:24 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:15:24 user nova-compute[74582]: </disk>
Nov 03 14:15:24 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:15:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Successfully detached device vdb from instance d62d7210-0ba4-4224-887b-ec3266072bb0 from the persistent domain config.
Nov 03 14:15:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d62d7210-0ba4-4224-887b-ec3266072bb0 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:15:24 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:15:24 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:15:24 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:15:24 user nova-compute[74582]:   <serial>5c6ccf9c-2ee4-4277-a510-1245b1390ff4</serial>
Nov 03 14:15:24 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:15:24 user nova-compute[74582]: </disk>
Nov 03 14:15:24 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:15:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Successfully created port: c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Successfully updated port: c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "refresh_cache-121a9119-b669-46f8-94e1-2336a2af437d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquired lock "refresh_cache-121a9119-b669-46f8-94e1-2336a2af437d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-changed-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Refreshing instance network info cache due to event network-changed-c85774cc-827c-495d-a145-464d1b18fa2d. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] Acquiring lock "refresh_cache-121a9119-b669-46f8-94e1-2336a2af437d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Updating instance_info_cache with network_info: [{"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Releasing lock "refresh_cache-121a9119-b669-46f8-94e1-2336a2af437d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Instance network_info: |[{"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] Acquired lock "refresh_cache-121a9119-b669-46f8-94e1-2336a2af437d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:15:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Refreshing network info cache for port c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:15:26 user nova-compute[74582]: DEBUG nova.network.neutron [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Updated VIF entry in instance network info cache for port c85774cc-827c-495d-a145-464d1b18fa2d. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:15:26 user nova-compute[74582]: DEBUG nova.network.neutron [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Updating instance_info_cache with network_info: [{"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:15:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f698ede2-7cba-498c-83d5-ca5a0990937c req-7b98c7c1-fe70-42d1-88ee-62bb3175ce3f service nova] Releasing lock "refresh_cache-121a9119-b669-46f8-94e1-2336a2af437d" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:15:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxzZUpNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:15:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:15:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:15:27 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff99927-112d-4c93-92b5-b366de81638c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:15:27 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f455110-6fe8-40fc-aec3-555f0677a446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4] added
Nov 03 14:15:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee607d6-3bdf-44be-8de8-410edf914b9d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933a6da-e42c-4ec1-8c83-8e3500e0b942]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxzZUpNh {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxzZUpNh" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb93d35-6f24-42e1-8b96-308009761f26]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxzZUpNh'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec691c-366a-4987-8c19-a87cbe40f63e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4605963-a51f-4199-97d2-28fdfb8bfc73]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:15:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:15:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d12229-0614-49c7-982d-d4388f25c743]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260]
Nov 03 14:15:27 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260] successful.
Nov 03 14:15:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cf1c6-80d1-4c3a-bf80-7acf72aeba9d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f579f04-3efa-4a87-9868-cf3d1f56a0a1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:15:27 user nova-compute[74582]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:15:27 user nova-compute[74582]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e35e8-bb1c-440f-b4f8-2cb1f1c26020]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxzZUpNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26334623065343738', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623065343738', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG nova.objects.instance [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'flavor' on Instance uuid 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:15:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:15:28 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:15:28 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:15:28 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:15:28 user nova-compute[74582]:   <serial>ef73c388-0641-4153-be41-e69598d674b4</serial>
Nov 03 14:15:28 user nova-compute[74582]: </disk>
Nov 03 14:15:28 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] No VIF found with MAC fa:16:3e:d5:af:42, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-6bda8967-b07a-40d9-b7df-9b7eac220a88 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.289s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG os_brick.utils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db86072-7c1f-4303-b0e5-d6302530ad32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f1d56-0df4-4b5c-8dbc-0ddf3fb31143]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454ea69-4e42-4f1d-a348-b7a0e1b7c3c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20d4dde-ab51-4579-942c-6df08d4e09a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:15:29 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:15:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc1cf77-511f-4a03-94ae-67e1c33bfd52]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG os_brick.utils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:15:29 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Updating existing volume attachment record: 751bf9cb-06de-4f30-b0d8-fbef1b31bb18 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:15:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:15:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:15:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d62d7210-0ba4-4224-887b-ec3266072bb0 is timed out.
Nov 03 14:15:44 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Successfully detached device vdb from instance d62d7210-0ba4-4224-887b-ec3266072bb0 from the live domain config.
Nov 03 14:15:44 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdfHAnPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:15:44 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[800250d8-de48-4fdc-894e-b022d0d23f85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:15:44 user nova-compute[74582]: No targets found.
Nov 03 14:15:44 user nova-compute[74582]: iSNS:
Nov 03 14:15:44 user nova-compute[74582]: No targets found.
Nov 03 14:15:44 user nova-compute[74582]: STATIC:
Nov 03 14:15:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4
Nov 03 14:15:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:15:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:15:44 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4
Nov 03 14:15:44 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:15:44 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:15:44 user nova-compute[74582]: FIRMWARE:
Nov 03 14:15:44 user nova-compute[74582]: No targets found.
Nov 03 14:15:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:15:44 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:15:44 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c115b5-fe57-47f1-9de3-514354e534d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b0e7c-54a3-40f6-baf2-6e3c6ef731f1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:15:44 user nova-compute[74582]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 (non-flash)
Nov 03 14:15:44 user nova-compute[74582]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:44 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683c1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ca1cb1-d07e-472d-b705-cc3daf06a40d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[10913776-16ba-49a8-8aad-3ab7833591fa]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46f1e02-6c7f-4890-8537-21dedfde499f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1be369-3b14-4c79-9f49-0d6149ce1c0b]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[583fc5b8-848f-4076-ab12-0fd3379fba35]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[510f59db-4e9e-4aa3-906d-367977cf08bf]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260]
Nov 03 14:15:45 user nova-compute[74582]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4, portal: 172.16.0.220,3260] successful.
Nov 03 14:15:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6ccf9c-2ee4-4277-a510-1245b1390ff4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fc5bc-ae8b-47ad-80d6-ab3cb579e452]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] <== disconnect_volume: return (287ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'flavor' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:15:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ef64d453-a392-4d17-b4da-d28e98561e9f tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:15:50 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Creating image(s)
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Ensure instance console log exists: /opt/stack/data/nova/instances/121a9119-b669-46f8-94e1-2336a2af437d/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Start _get_guest_xml network_info=[{"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '751bf9cb-06de-4f30-b0d8-fbef1b31bb18', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDgMClSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '121a9119-b669-46f8-94e1-2336a2af437d', 'attached_at': '', 'detached_at': '', 'volume_id': '01aef467-6375-4d60-a84b-4e44c3c3bbed', 'serial': '01aef467-6375-4d60-a84b-4e44c3c3bbed'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:15:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:15:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDgMClSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:15:50 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:15:50 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:15:50 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f9191b-8add-4492-b086-7c4ce4e2164d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:15:50 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e023a6-1b18-477d-b196-c9cb51f93df2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed] added
Nov 03 14:15:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aea446-7a40-4910-8dfd-9f7f41e9fa23]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb5381-da7b-48cc-a95b-304c826254ac]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDgMClSV {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDgMClSV" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f17c5d1-a61f-4dca-a7ea-78b34a70624c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tDgMClSV'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b2c8a-a62d-45f4-b39e-e5e061084fae]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e688b517-1c91-435a-8559-3e8357da3f24]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[75399238-0808-4eb6-a343-51fa8da01016]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260]
Nov 03 14:15:50 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260] successful.
Nov 03 14:15:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eb41e5-afdd-4721-b590-164bd0297cfb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b38f8e8-a752-4e08-9268-7529ca47bbff]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:50 user nova-compute[74582]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:15:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:15:50 user nova-compute[74582]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:15:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1366cec-2eca-4540-a2cb-d2fdb05f06dc]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:15:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDgMClSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26634666437646335', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634666437646335', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-368849863',display_name='tempest-TestVolumeBootPattern-server-368849863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-368849863',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-eiif0t7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:15:24Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=121a9119-b669-46f8-94e1-2336a2af437d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'pci_devices' on Instance uuid 121a9119-b669-46f8-94e1-2336a2af437d {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:15:51 user nova-compute[74582]:   <uuid>121a9119-b669-46f8-94e1-2336a2af437d</uuid>
Nov 03 14:15:51 user nova-compute[74582]:   <name>instance-0000002b</name>
Nov 03 14:15:51 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:15:51 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:15:51 user nova-compute[74582]:   <metadata>
Nov 03 14:15:51 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:15:51 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:15:51 user nova-compute[74582]:       <nova:name>tempest-TestVolumeBootPattern-server-368849863</nova:name>
Nov 03 14:15:51 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:15:50</nova:creationTime>
Nov 03 14:15:51 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:15:51 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:15:51 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:15:51 user nova-compute[74582]:       <nova:owner>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:user uuid="c726e17f780a483b8b3a220dfc34125d">tempest-TestVolumeBootPattern-1092687553-project-member</nova:user>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:project uuid="333545c5c61843ac89215bcc49b520e3">tempest-TestVolumeBootPattern-1092687553</nova:project>
Nov 03 14:15:51 user nova-compute[74582]:       </nova:owner>
Nov 03 14:15:51 user nova-compute[74582]:       <nova:ports>
Nov 03 14:15:51 user nova-compute[74582]:         <nova:port uuid="c85774cc-827c-495d-a145-464d1b18fa2d">
Nov 03 14:15:51 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 14:15:51 user nova-compute[74582]:         </nova:port>
Nov 03 14:15:51 user nova-compute[74582]:       </nova:ports>
Nov 03 14:15:51 user nova-compute[74582]:     </nova:instance>
Nov 03 14:15:51 user nova-compute[74582]:   </metadata>
Nov 03 14:15:51 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:15:51 user nova-compute[74582]:     <system>
Nov 03 14:15:51 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:15:51 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:15:51 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:15:51 user nova-compute[74582]:       <entry name="serial">121a9119-b669-46f8-94e1-2336a2af437d</entry>
Nov 03 14:15:51 user nova-compute[74582]:       <entry name="uuid">121a9119-b669-46f8-94e1-2336a2af437d</entry>
Nov 03 14:15:51 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:15:51 user nova-compute[74582]:     </system>
Nov 03 14:15:51 user nova-compute[74582]:   </sysinfo>
Nov 03 14:15:51 user nova-compute[74582]:   <os>
Nov 03 14:15:51 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:15:51 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:15:51 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:15:51 user nova-compute[74582]:   </os>
Nov 03 14:15:51 user nova-compute[74582]:   <features>
Nov 03 14:15:51 user nova-compute[74582]:     <acpi/>
Nov 03 14:15:51 user nova-compute[74582]:     <apic/>
Nov 03 14:15:51 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:15:51 user nova-compute[74582]:   </features>
Nov 03 14:15:51 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:15:51 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:15:51 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:15:51 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:15:51 user nova-compute[74582]:   </clock>
Nov 03 14:15:51 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:15:51 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:15:51 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:15:51 user nova-compute[74582]:   </cpu>
Nov 03 14:15:51 user nova-compute[74582]:   <devices>
Nov 03 14:15:51 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:15:51 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:15:51 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 14:15:51 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:15:51 user nova-compute[74582]:       <serial>01aef467-6375-4d60-a84b-4e44c3c3bbed</serial>
Nov 03 14:15:51 user nova-compute[74582]:     </disk>
Nov 03 14:15:51 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:15:51 user nova-compute[74582]:       <mac address="fa:16:3e:5a:1b:a4"/>
Nov 03 14:15:51 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:15:51 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:15:51 user nova-compute[74582]:       <target dev="tapc85774cc-82"/>
Nov 03 14:15:51 user nova-compute[74582]:     </interface>
Nov 03 14:15:51 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:15:51 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/121a9119-b669-46f8-94e1-2336a2af437d/console.log" append="off"/>
Nov 03 14:15:51 user nova-compute[74582]:     </serial>
Nov 03 14:15:51 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:15:51 user nova-compute[74582]:     <video>
Nov 03 14:15:51 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:15:51 user nova-compute[74582]:     </video>
Nov 03 14:15:51 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:15:51 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:15:51 user nova-compute[74582]:     </rng>
Nov 03 14:15:51 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:15:51 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:15:51 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:15:51 user nova-compute[74582]:     </memballoon>
Nov 03 14:15:51 user nova-compute[74582]:   </devices>
Nov 03 14:15:51 user nova-compute[74582]: </domain>
Nov 03 14:15:51 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-368849863',display_name='tempest-TestVolumeBootPattern-server-368849863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-368849863',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-eiif0t7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:15:24Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=121a9119-b669-46f8-94e1-2336a2af437d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG os_vif [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26d62f81-cdb9-54bd-8937-457dff2cd78c', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc85774cc-82, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc85774cc-82, col_values=(('qos', UUID('7a8068b7-d8cd-4d6c-9b1c-e4e2635169ae')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc85774cc-82, col_values=(('external_ids', {'iface-id': 'c85774cc-827c-495d-a145-464d1b18fa2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:1b:a4', 'vm-uuid': '121a9119-b669-46f8-94e1-2336a2af437d'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:51 user nova-compute[74582]: INFO os_vif [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82')
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:15:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No VIF found with MAC fa:16:3e:5a:1b:a4, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:15:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0aba07a-02a2-475a-a739-08a4aff1923d req-62528bb6-c777-4627-bd27-febd83e90f0b service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0aba07a-02a2-475a-a739-08a4aff1923d req-62528bb6-c777-4627-bd27-febd83e90f0b service nova] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0aba07a-02a2-475a-a739-08a4aff1923d req-62528bb6-c777-4627-bd27-febd83e90f0b service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-c0aba07a-02a2-475a-a739-08a4aff1923d req-62528bb6-c777-4627-bd27-febd83e90f0b service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-c0aba07a-02a2-475a-a739-08a4aff1923d req-62528bb6-c777-4627-bd27-febd83e90f0b service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] No waiting events found dispatching network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:15:53 user nova-compute[74582]: WARNING nova.compute.manager [req-c0aba07a-02a2-475a-a739-08a4aff1923d req-62528bb6-c777-4627-bd27-febd83e90f0b service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received unexpected event network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d for instance with vm_state building and task_state spawning.
Nov 03 14:15:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:15:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Instance spawned successfully.
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:15:55 user nova-compute[74582]: INFO nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:15:55 user nova-compute[74582]: INFO nova.compute.manager [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Took 32.46 seconds to build instance.
Nov 03 14:15:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9b46fdb6-2f53-4e06-ae13-5cfcc87013e4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "121a9119-b669-46f8-94e1-2336a2af437d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.586s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-48854693-6efe-4e93-9f27-b8736bae8b0b req-dc911499-4adc-4f7a-a463-b6a8bb56e6ed service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-48854693-6efe-4e93-9f27-b8736bae8b0b req-dc911499-4adc-4f7a-a463-b6a8bb56e6ed service nova] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-48854693-6efe-4e93-9f27-b8736bae8b0b req-dc911499-4adc-4f7a-a463-b6a8bb56e6ed service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-48854693-6efe-4e93-9f27-b8736bae8b0b req-dc911499-4adc-4f7a-a463-b6a8bb56e6ed service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:15:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-48854693-6efe-4e93-9f27-b8736bae8b0b req-dc911499-4adc-4f7a-a463-b6a8bb56e6ed service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] No waiting events found dispatching network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:15:55 user nova-compute[74582]: WARNING nova.compute.manager [req-48854693-6efe-4e93-9f27-b8736bae8b0b req-dc911499-4adc-4f7a-a463-b6a8bb56e6ed service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received unexpected event network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d for instance with vm_state active and task_state None.
Nov 03 14:15:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:15:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:16:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:14 user nova-compute[74582]: INFO nova.compute.manager [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Terminating instance
Nov 03 14:16:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-b6ad9eda-63c6-4ce1-884f-c913acd6b7bf req-0cdea012-ce5d-42c6-829a-0a9bb07d6ab0 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b6ad9eda-63c6-4ce1-884f-c913acd6b7bf req-0cdea012-ce5d-42c6-829a-0a9bb07d6ab0 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b6ad9eda-63c6-4ce1-884f-c913acd6b7bf req-0cdea012-ce5d-42c6-829a-0a9bb07d6ab0 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b6ad9eda-63c6-4ce1-884f-c913acd6b7bf req-0cdea012-ce5d-42c6-829a-0a9bb07d6ab0 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-b6ad9eda-63c6-4ce1-884f-c913acd6b7bf req-0cdea012-ce5d-42c6-829a-0a9bb07d6ab0 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-b6ad9eda-63c6-4ce1-884f-c913acd6b7bf req-0cdea012-ce5d-42c6-829a-0a9bb07d6ab0 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-unplugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:16:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Instance destroyed successfully.
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lazy-loading 'resources' on Instance uuid d62d7210-0ba4-4224-887b-ec3266072bb0 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2073427584',display_name='tempest-ServerStableDeviceRescueTest-server-2073427584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2073427584',id=36,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLhMeU162JG7Wng8TnrmOxRS8FG4U7S7wLMbRvIFxpbtkI/cevU3/s+YwrSS1eY4canYYaWf88nqSBbhPKZQhuHHZdBZcG+zEyHX2KORDFjb/M0IiTJF54s987Tn3lRWA==',key_name='tempest-keypair-984564094',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d445081fe9645b0961089dfa2c9ca85',ramdisk_id='',reservation_id='r-wp79qwwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1359208006',owner_user_name='tempest-ServerStableDeviceRescueTest-1359208006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06455365cee44bea82e923ffb923b23f',uuid=d62d7210-0ba4-4224-887b-ec3266072bb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converting VIF {"id": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "address": "fa:16:3e:8f:20:d1", "network": {"id": "7ce80db0-f5db-411f-8bff-cdc18faa5793", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2004991080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d445081fe9645b0961089dfa2c9ca85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3673527d-6c", "ovs_interfaceid": "3673527d-6ca0-48b6-b6ee-b8ab9f4270c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG os_vif [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3673527d-6c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=621d751a-d0da-471a-a4af-911e3f3917da) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:15 user nova-compute[74582]: INFO os_vif [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:20:d1,bridge_name='br-int',has_traffic_filtering=True,id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4,network=Network(7ce80db0-f5db-411f-8bff-cdc18faa5793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3673527d-6c')
Nov 03 14:16:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Deleting instance files /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0_del
Nov 03 14:16:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Deletion of /opt/stack/data/nova/instances/d62d7210-0ba4-4224-887b-ec3266072bb0_del complete
Nov 03 14:16:15 user nova-compute[74582]: INFO nova.compute.manager [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 14:16:15 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:16:15 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:16:16 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Took 0.75 seconds to deallocate network for instance.
Nov 03 14:16:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-4cd41c48-d3d1-4e5b-b4c3-958cea351f82 req-ecdc628c-0815-41d1-96e7-eb582fa217d5 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-deleted-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:16 user nova-compute[74582]: INFO nova.compute.manager [req-4cd41c48-d3d1-4e5b-b4c3-958cea351f82 req-ecdc628c-0815-41d1-96e7-eb582fa217d5 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Neutron deleted interface 3673527d-6ca0-48b6-b6ee-b8ab9f4270c4; detaching it from the instance and deleting it from the info cache
Nov 03 14:16:16 user nova-compute[74582]: DEBUG nova.network.neutron [req-4cd41c48-d3d1-4e5b-b4c3-958cea351f82 req-ecdc628c-0815-41d1-96e7-eb582fa217d5 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-4cd41c48-d3d1-4e5b-b4c3-958cea351f82 req-ecdc628c-0815-41d1-96e7-eb582fa217d5 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Detach interface failed, port_id=3673527d-6ca0-48b6-b6ee-b8ab9f4270c4, reason: Instance d62d7210-0ba4-4224-887b-ec3266072bb0 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:16:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:16 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Deleted allocations for instance d62d7210-0ba4-4224-887b-ec3266072bb0
Nov 03 14:16:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a779d710-ea5e-45f2-9602-ad41c8c66abf tempest-ServerStableDeviceRescueTest-1359208006 tempest-ServerStableDeviceRescueTest-1359208006-project-member] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-6decbc4e-6b4d-4142-85a9-a1c99600c4e5 req-91ef5c47-6020-4cf9-b12e-fcba3c485500 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6decbc4e-6b4d-4142-85a9-a1c99600c4e5 req-91ef5c47-6020-4cf9-b12e-fcba3c485500 service nova] Acquiring lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6decbc4e-6b4d-4142-85a9-a1c99600c4e5 req-91ef5c47-6020-4cf9-b12e-fcba3c485500 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6decbc4e-6b4d-4142-85a9-a1c99600c4e5 req-91ef5c47-6020-4cf9-b12e-fcba3c485500 service nova] Lock "d62d7210-0ba4-4224-887b-ec3266072bb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-6decbc4e-6b4d-4142-85a9-a1c99600c4e5 req-91ef5c47-6020-4cf9-b12e-fcba3c485500 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] No waiting events found dispatching network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:17 user nova-compute[74582]: WARNING nova.compute.manager [req-6decbc4e-6b4d-4142-85a9-a1c99600c4e5 req-91ef5c47-6020-4cf9-b12e-fcba3c485500 service nova] [instance: d62d7210-0ba4-4224-887b-ec3266072bb0] Received unexpected event network-vif-plugged-3673527d-6ca0-48b6-b6ee-b8ab9f4270c4 for instance with vm_state deleted and task_state None.
Nov 03 14:16:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:16:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:16:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:21 user nova-compute[74582]: INFO nova.compute.manager [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Rescuing
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-3509b56e-a6be-464a-8691-8c4f2375f01f req-4fa2b675-5fa3-4ff8-a557-ab200c2906d9 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3509b56e-a6be-464a-8691-8c4f2375f01f req-4fa2b675-5fa3-4ff8-a557-ab200c2906d9 service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3509b56e-a6be-464a-8691-8c4f2375f01f req-4fa2b675-5fa3-4ff8-a557-ab200c2906d9 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3509b56e-a6be-464a-8691-8c4f2375f01f req-4fa2b675-5fa3-4ff8-a557-ab200c2906d9 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-3509b56e-a6be-464a-8691-8c4f2375f01f req-4fa2b675-5fa3-4ff8-a557-ab200c2906d9 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:22 user nova-compute[74582]: WARNING nova.compute.manager [req-3509b56e-a6be-464a-8691-8c4f2375f01f req-4fa2b675-5fa3-4ff8-a557-ab200c2906d9 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance destroyed successfully.
Nov 03 14:16:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Attempting rescue
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74582) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 14:16:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Creating image(s)
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue" returned: 0 in 0.054s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'migration_context' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.base [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<9658a040-77d8-45da-bb65-930ee5466b1c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Start _get_guest_xml network_info=[{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:54:d3:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'resources' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.base [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<9658a040-77d8-45da-bb65-930ee5466b1c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'numa_topology' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.base [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<9658a040-77d8-45da-bb65-930ee5466b1c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:16:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.base [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<9658a040-77d8-45da-bb65-930ee5466b1c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015289643',display_name='tempest-ServerRescueNegativeTestJSON-server-2015289643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015289643',id=42,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-2n17jzb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:14:38Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=9658a040-77d8-45da-bb65-930ee5466b1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:54:d3:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:54:d3:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'pci_devices' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.objects.base [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<9658a040-77d8-45da-bb65-930ee5466b1c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:16:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:16:22 user nova-compute[74582]:   <uuid>9658a040-77d8-45da-bb65-930ee5466b1c</uuid>
Nov 03 14:16:22 user nova-compute[74582]:   <name>instance-0000002a</name>
Nov 03 14:16:22 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:16:22 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:16:22 user nova-compute[74582]:   <metadata>
Nov 03 14:16:22 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:16:22 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:16:22 user nova-compute[74582]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2015289643</nova:name>
Nov 03 14:16:22 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:16:22</nova:creationTime>
Nov 03 14:16:22 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:16:22 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:16:22 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:16:22 user nova-compute[74582]:       <nova:owner>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:user uuid="86cb25ef9de143a5a55d341a089e19de">tempest-ServerRescueNegativeTestJSON-1868952631-project-member</nova:user>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:project uuid="9f3f5290550c487fa7c35f987312a79b">tempest-ServerRescueNegativeTestJSON-1868952631</nova:project>
Nov 03 14:16:22 user nova-compute[74582]:       </nova:owner>
Nov 03 14:16:22 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:16:22 user nova-compute[74582]:       <nova:ports>
Nov 03 14:16:22 user nova-compute[74582]:         <nova:port uuid="6a67faf6-cb27-45cf-8561-6a54e3d320ad">
Nov 03 14:16:22 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 14:16:22 user nova-compute[74582]:         </nova:port>
Nov 03 14:16:22 user nova-compute[74582]:       </nova:ports>
Nov 03 14:16:22 user nova-compute[74582]:     </nova:instance>
Nov 03 14:16:22 user nova-compute[74582]:   </metadata>
Nov 03 14:16:22 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:16:22 user nova-compute[74582]:     <system>
Nov 03 14:16:22 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:16:22 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:16:22 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:16:22 user nova-compute[74582]:       <entry name="serial">9658a040-77d8-45da-bb65-930ee5466b1c</entry>
Nov 03 14:16:22 user nova-compute[74582]:       <entry name="uuid">9658a040-77d8-45da-bb65-930ee5466b1c</entry>
Nov 03 14:16:22 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:16:22 user nova-compute[74582]:     </system>
Nov 03 14:16:22 user nova-compute[74582]:   </sysinfo>
Nov 03 14:16:22 user nova-compute[74582]:   <os>
Nov 03 14:16:22 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:16:22 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:16:22 user nova-compute[74582]:   </os>
Nov 03 14:16:22 user nova-compute[74582]:   <features>
Nov 03 14:16:22 user nova-compute[74582]:     <acpi/>
Nov 03 14:16:22 user nova-compute[74582]:     <apic/>
Nov 03 14:16:22 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:16:22 user nova-compute[74582]:   </features>
Nov 03 14:16:22 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:16:22 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:16:22 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:16:22 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:16:22 user nova-compute[74582]:   </clock>
Nov 03 14:16:22 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:16:22 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:16:22 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:16:22 user nova-compute[74582]:   </cpu>
Nov 03 14:16:22 user nova-compute[74582]:   <devices>
Nov 03 14:16:22 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:16:22 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:16:22 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue"/>
Nov 03 14:16:22 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:16:22 user nova-compute[74582]:     </disk>
Nov 03 14:16:22 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:16:22 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:16:22 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk"/>
Nov 03 14:16:22 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:16:22 user nova-compute[74582]:     </disk>
Nov 03 14:16:22 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:16:22 user nova-compute[74582]:       <mac address="fa:16:3e:54:d3:74"/>
Nov 03 14:16:22 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:16:22 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:16:22 user nova-compute[74582]:       <target dev="tap6a67faf6-cb"/>
Nov 03 14:16:22 user nova-compute[74582]:     </interface>
Nov 03 14:16:22 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:16:22 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/console.log" append="off"/>
Nov 03 14:16:22 user nova-compute[74582]:     </serial>
Nov 03 14:16:22 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:16:22 user nova-compute[74582]:     <video>
Nov 03 14:16:22 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:16:22 user nova-compute[74582]:     </video>
Nov 03 14:16:22 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:16:22 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:16:22 user nova-compute[74582]:     </rng>
Nov 03 14:16:22 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:16:22 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:16:22 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:16:22 user nova-compute[74582]:     </memballoon>
Nov 03 14:16:22 user nova-compute[74582]:   </devices>
Nov 03 14:16:22 user nova-compute[74582]: </domain>
Nov 03 14:16:22 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:16:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance destroyed successfully.
Nov 03 14:16:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:54:d3:74, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:16:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:16:23 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:16:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8353MB free_disk=25.03540802001953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:24 user nova-compute[74582]: WARNING nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:24 user nova-compute[74582]: WARNING nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:24 user nova-compute[74582]: WARNING nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:24 user nova-compute[74582]: WARNING nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:24 user nova-compute[74582]: WARNING nova.compute.manager [req-728c58bc-e0a2-44cc-a0a1-3af04502d80f req-e83b91dc-4c77-451c-ad71-41b6b537679b service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 121a9119-b669-46f8-94e1-2336a2af437d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:24 user nova-compute[74582]: INFO nova.compute.manager [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Detaching volume ef73c388-0641-4153-be41-e69598d674b4
Nov 03 14:16:24 user nova-compute[74582]: INFO nova.virt.block_device [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Attempting to driver detach volume ef73c388-0641-4153-be41-e69598d674b4 from mountpoint /dev/vdb
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Attempting to detach device vdb from instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:16:24 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:16:24 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:16:24 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:16:24 user nova-compute[74582]:   <serial>ef73c388-0641-4153-be41-e69598d674b4</serial>
Nov 03 14:16:24 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:16:24 user nova-compute[74582]: </disk>
Nov 03 14:16:24 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully detached device vdb from instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 from the persistent domain config.
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:16:24 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:16:24 user nova-compute[74582]:   <source dev="/dev/sdc"/>
Nov 03 14:16:24 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:16:24 user nova-compute[74582]:   <serial>ef73c388-0641-4153-be41-e69598d674b4</serial>
Nov 03 14:16:24 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:16:24 user nova-compute[74582]: </disk>
Nov 03 14:16:24 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:16:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:16:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:26 user nova-compute[74582]: WARNING nova.compute.manager [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:26 user nova-compute[74582]: WARNING nova.compute.manager [req-7d0b20dc-bf53-4053-a84e-758df20dfad6 req-9d772b30-ccf2-48b5-8f77-1f36f63d06e3 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state active and task_state rescuing.
Nov 03 14:16:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cbd82969-1576-4be3-adbe-6bff75bf8b9d tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:16:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:16:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:16:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:16:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:45 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 is timed out.
Nov 03 14:16:45 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully detached device vdb from instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 from the live domain config.
Nov 03 14:16:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxzZUpNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:16:45 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffcbbe7-0991-485e-82fd-802f0a3fa40f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:16:45 user nova-compute[74582]: No targets found.
Nov 03 14:16:45 user nova-compute[74582]: iSNS:
Nov 03 14:16:45 user nova-compute[74582]: No targets found.
Nov 03 14:16:45 user nova-compute[74582]: STATIC:
Nov 03 14:16:45 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed
Nov 03 14:16:45 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:16:45 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:16:45 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4
Nov 03 14:16:45 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:16:45 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:16:45 user nova-compute[74582]: FIRMWARE:
Nov 03 14:16:45 user nova-compute[74582]: No targets found.
Nov 03 14:16:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:16:45 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:16:45 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c4004-c27d-4e8f-98f2-a0999748224b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d62e7f-4899-4ab9-b062-3f35790c1bbd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:16:45 user nova-compute[74582]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:16:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 (non-flash)
Nov 03 14:16:45 user nova-compute[74582]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:16:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f801fcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52b1ed5-1af5-42b2-afab-d7291dc4d199]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8a3e3-1bfb-4ed1-ac5c-1646d3dadcba]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9385194-90e5-45bb-bfd8-ca8e3276b295]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa0ff2-6525-4e68-b12d-130badec059f]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[097f443b-a987-4f35-9762-45a02aa6cb02]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5627cf-abbd-4f28-9f49-0fa0ad89375a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260]
Nov 03 14:16:45 user nova-compute[74582]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4, portal: 172.16.0.220,3260] successful.
Nov 03 14:16:45 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2a86f-7686-4211-b3ae-bdd1507f1fa2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== disconnect_volume: return (317ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:16:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'flavor' on Instance uuid 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a1fc1dca-1061-41cc-89e4-4ae2efbba759 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.751s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:46 user nova-compute[74582]: INFO nova.compute.manager [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Terminating instance
Nov 03 14:16:46 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-7fd36e2a-ab24-466b-8ac7-250f5e7ab38b req-acf65909-cf96-4853-afad-b7b84ced9aed service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-vif-unplugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7fd36e2a-ab24-466b-8ac7-250f5e7ab38b req-acf65909-cf96-4853-afad-b7b84ced9aed service nova] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7fd36e2a-ab24-466b-8ac7-250f5e7ab38b req-acf65909-cf96-4853-afad-b7b84ced9aed service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7fd36e2a-ab24-466b-8ac7-250f5e7ab38b req-acf65909-cf96-4853-afad-b7b84ced9aed service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-7fd36e2a-ab24-466b-8ac7-250f5e7ab38b req-acf65909-cf96-4853-afad-b7b84ced9aed service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] No waiting events found dispatching network-vif-unplugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-7fd36e2a-ab24-466b-8ac7-250f5e7ab38b req-acf65909-cf96-4853-afad-b7b84ced9aed service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-vif-unplugged-6e6f006e-e926-4549-88a9-59448981f023 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Instance destroyed successfully.
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lazy-loading 'resources' on Instance uuid 1c80ef52-7f9d-465e-aeee-1957849fd2d9 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-741409540',display_name='tempest-VolumesSnapshotTestJSON-instance-741409540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-741409540',id=40,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHl5aipNB6WNzuq/QslS23X4mCz9/thF3tWmz4F3o2h6tUlDH0wWfxUOUywau5uPz7RhxqPdSPD4+F9vyKTc/coxp+nGOxNNkfxRAH7mVCpw4M63bSxp73Lg2UUqyN1Vg==',key_name='tempest-keypair-446499307',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72750b673ec946e08a94d8691bfc8e83',ramdisk_id='',reservation_id='r-bdvrulv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2065237936',owner_user_name='tempest-VolumesSnapshotTestJSON-2065237936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21a795451e044a8394ff26ca920c44f1',uuid=1c80ef52-7f9d-465e-aeee-1957849fd2d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converting VIF {"id": "6e6f006e-e926-4549-88a9-59448981f023", "address": "fa:16:3e:d5:af:42", "network": {"id": "aceb5c27-1f30-467a-8b72-c8fe84021b16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-663206491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72750b673ec946e08a94d8691bfc8e83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6f006e-e9", "ovs_interfaceid": "6e6f006e-e926-4549-88a9-59448981f023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_vif [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e6f006e-e9, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9d36f5a-ea70-4b2b-b4c4-8f1f594690c9) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:47 user nova-compute[74582]: INFO os_vif [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:af:42,bridge_name='br-int',has_traffic_filtering=True,id=6e6f006e-e926-4549-88a9-59448981f023,network=Network(aceb5c27-1f30-467a-8b72-c8fe84021b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e6f006e-e9')
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxzZUpNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:16:47 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f3c9e1-4b30-4f17-80ad-28d753c64753]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:16:47 user nova-compute[74582]: No targets found.
Nov 03 14:16:47 user nova-compute[74582]: iSNS:
Nov 03 14:16:47 user nova-compute[74582]: No targets found.
Nov 03 14:16:47 user nova-compute[74582]: STATIC:
Nov 03 14:16:47 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed
Nov 03 14:16:47 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:16:47 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:16:47 user nova-compute[74582]: FIRMWARE:
Nov 03 14:16:47 user nova-compute[74582]: No targets found.
Nov 03 14:16:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:16:47 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:16:47 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef73c388-0641-4153-be41-e69598d674b4', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0ce46-2ded-4dc2-9d84-a891aaf1af17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c256d-6976-4a2d-93ba-4cb686e9ebb1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:16:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:16:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f802ea200>, {}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Disconnecting from: [] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] <== disconnect_volume: return (72ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:16:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Deleting instance files /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9_del
Nov 03 14:16:47 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Deletion of /opt/stack/data/nova/instances/1c80ef52-7f9d-465e-aeee-1957849fd2d9_del complete
Nov 03 14:16:47 user nova-compute[74582]: INFO nova.compute.manager [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 14:16:47 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:16:47 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-5c370fee-bf07-46e9-b16a-be8e6e1fcbad req-86c951e4-b084-4dbe-bba2-bdbf8eda8875 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-vif-deleted-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:48 user nova-compute[74582]: INFO nova.compute.manager [req-5c370fee-bf07-46e9-b16a-be8e6e1fcbad req-86c951e4-b084-4dbe-bba2-bdbf8eda8875 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Neutron deleted interface 6e6f006e-e926-4549-88a9-59448981f023; detaching it from the instance and deleting it from the info cache
Nov 03 14:16:48 user nova-compute[74582]: DEBUG nova.network.neutron [req-5c370fee-bf07-46e9-b16a-be8e6e1fcbad req-86c951e4-b084-4dbe-bba2-bdbf8eda8875 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:16:48 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Took 1.23 seconds to deallocate network for instance.
Nov 03 14:16:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-5c370fee-bf07-46e9-b16a-be8e6e1fcbad req-86c951e4-b084-4dbe-bba2-bdbf8eda8875 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Detach interface failed, port_id=6e6f006e-e926-4549-88a9-59448981f023, reason: Instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:16:48 user nova-compute[74582]: WARNING nova.volume.cinder [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Attachment dcee1f65-f55f-4a0e-a747-c2b3146d91e3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = dcee1f65-f55f-4a0e-a747-c2b3146d91e3. (HTTP 404) (Request-ID: req-e6e9a9c0-a283-40f0-9256-9c1e0df24494)
Nov 03 14:16:48 user nova-compute[74582]: INFO nova.compute.manager [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Took 0.04 seconds to detach 1 volumes for instance.
Nov 03 14:16:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-eef5bd6c-7ce0-4fab-b04e-728dfa752d5d req-523071f3-df25-452f-b339-e406fabaaa96 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received event network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eef5bd6c-7ce0-4fab-b04e-728dfa752d5d req-523071f3-df25-452f-b339-e406fabaaa96 service nova] Acquiring lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eef5bd6c-7ce0-4fab-b04e-728dfa752d5d req-523071f3-df25-452f-b339-e406fabaaa96 service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-eef5bd6c-7ce0-4fab-b04e-728dfa752d5d req-523071f3-df25-452f-b339-e406fabaaa96 service nova] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-eef5bd6c-7ce0-4fab-b04e-728dfa752d5d req-523071f3-df25-452f-b339-e406fabaaa96 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] No waiting events found dispatching network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:16:48 user nova-compute[74582]: WARNING nova.compute.manager [req-eef5bd6c-7ce0-4fab-b04e-728dfa752d5d req-523071f3-df25-452f-b339-e406fabaaa96 service nova] [instance: 1c80ef52-7f9d-465e-aeee-1957849fd2d9] Received unexpected event network-vif-plugged-6e6f006e-e926-4549-88a9-59448981f023 for instance with vm_state active and task_state deleting.
Nov 03 14:16:49 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:16:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:16:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:49 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Deleted allocations for instance 1c80ef52-7f9d-465e-aeee-1957849fd2d9
Nov 03 14:16:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d26209cd-41d4-4fed-9fb2-5342ac336186 tempest-VolumesSnapshotTestJSON-2065237936 tempest-VolumesSnapshotTestJSON-2065237936-project-member] Lock "1c80ef52-7f9d-465e-aeee-1957849fd2d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:16:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:16:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:08 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:09 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:17:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "121a9119-b669-46f8-94e1-2336a2af437d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:13 user nova-compute[74582]: INFO nova.compute.manager [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Terminating instance
Nov 03 14:17:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-fa54c126-aa13-49cd-a1c1-530fd6327512 req-21ad7f70-a9b0-4600-b45e-a46a6dbee5a4 service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-vif-unplugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fa54c126-aa13-49cd-a1c1-530fd6327512 req-21ad7f70-a9b0-4600-b45e-a46a6dbee5a4 service nova] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fa54c126-aa13-49cd-a1c1-530fd6327512 req-21ad7f70-a9b0-4600-b45e-a46a6dbee5a4 service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fa54c126-aa13-49cd-a1c1-530fd6327512 req-21ad7f70-a9b0-4600-b45e-a46a6dbee5a4 service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-fa54c126-aa13-49cd-a1c1-530fd6327512 req-21ad7f70-a9b0-4600-b45e-a46a6dbee5a4 service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] No waiting events found dispatching network-vif-unplugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:17:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-fa54c126-aa13-49cd-a1c1-530fd6327512 req-21ad7f70-a9b0-4600-b45e-a46a6dbee5a4 service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-vif-unplugged-c85774cc-827c-495d-a145-464d1b18fa2d for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:17:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Instance destroyed successfully.
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'resources' on Instance uuid 121a9119-b669-46f8-94e1-2336a2af437d {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-368849863',display_name='tempest-TestVolumeBootPattern-server-368849863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-368849863',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:15:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-eiif0t7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:15:55Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=121a9119-b669-46f8-94e1-2336a2af437d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "c85774cc-827c-495d-a145-464d1b18fa2d", "address": "fa:16:3e:5a:1b:a4", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85774cc-82", "ovs_interfaceid": "c85774cc-827c-495d-a145-464d1b18fa2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_vif [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc85774cc-82, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a8068b7-d8cd-4d6c-9b1c-e4e2635169ae) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:14 user nova-compute[74582]: INFO os_vif [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1b:a4,bridge_name='br-int',has_traffic_filtering=True,id=c85774cc-827c-495d-a145-464d1b18fa2d,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85774cc-82')
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDgMClSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:17:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b2cc0a-9ef9-4593-ba91-b55b3b455be2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:17:14 user nova-compute[74582]: No targets found.
Nov 03 14:17:14 user nova-compute[74582]: iSNS:
Nov 03 14:17:14 user nova-compute[74582]: No targets found.
Nov 03 14:17:14 user nova-compute[74582]: STATIC:
Nov 03 14:17:14 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed
Nov 03 14:17:14 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:17:14 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:17:14 user nova-compute[74582]: FIRMWARE:
Nov 03 14:17:14 user nova-compute[74582]: No targets found.
Nov 03 14:17:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:17:14 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:17:14 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b0b1f-1129-4a54-a8ec-60c621c51304]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[87868ea1-d03f-488d-b581-1b5a9684696c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:17:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed (non-flash)
Nov 03 14:17:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f8010e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[86595f05-8fc4-43e7-8163-c34f4319bb52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe10caa-526f-4ceb-b4f5-31a295bfe3ec]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c548a1dc-8350-48eb-8b91-38f9e17b479f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb1b7f-a6ef-4d5f-9e54-a9ec539273dd]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6d78009b-f4fd7dc54e11fc34', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6d78009b', '/dev/disk/by-id/scsi-26634666437646335') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c85ef1-e4fa-4051-b174-6439e24b2393]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb413d5-0383-46c6-84d9-c1ff05fde2a4]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d0a43-4167-4491-be6d-528d92a24544]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260]
Nov 03 14:17:14 user nova-compute[74582]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed, portal: 172.16.0.220,3260] successful.
Nov 03 14:17:14 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01aef467-6375-4d60-a84b-4e44c3c3bbed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb83fe8-4d91-4275-8921-b66aca2e71d1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== disconnect_volume: return (283ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:17:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Deleting instance files /opt/stack/data/nova/instances/121a9119-b669-46f8-94e1-2336a2af437d_del
Nov 03 14:17:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Deletion of /opt/stack/data/nova/instances/121a9119-b669-46f8-94e1-2336a2af437d_del complete
Nov 03 14:17:14 user nova-compute[74582]: INFO nova.compute.manager [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 03 14:17:14 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:17:14 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:17:15 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Took 0.60 seconds to deallocate network for instance.
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-3c05df9d-7214-4970-ad63-8135ff8ad3bd req-1e26d558-df18-4f31-b31c-de522910cac8 service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-vif-deleted-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:15 user nova-compute[74582]: INFO nova.compute.manager [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Terminating instance
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] During wait destroy, instance disappeared. {{(pid=74582) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 03 14:17:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Instance destroyed successfully.
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'resources' on Instance uuid c872e44a-e815-4f43-bbea-867d7a189c2e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-299992870',display_name='tempest-ServerActionsTestOtherA-server-1602014141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-299992870',id=22,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtl0xERP3j+KsAcfY+ZXBsjzwz0w8MMe5s3YYcbBiTVdgqCuN3k7PcBhDOTW6Raj3Gplcn4bqG+K0XUXlRBMOWcRa6tyoa9fwqa2+NVqNaGfC3/MqDB2PyInJ7Hc/fcRA==',key_name='tempest-keypair-1466447300',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:56:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-0yzrsjsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:03:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=c872e44a-e815-4f43-bbea-867d7a189c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "address": "fa:16:3e:b9:07:f2", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc121ca-a5", "ovs_interfaceid": "2cc121ca-a5ae-47ba-9fc3-9c32b7360790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_vif [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cc121ca-a5, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:17:15 user nova-compute[74582]: INFO os_vif [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f2,bridge_name='br-int',has_traffic_filtering=True,id=2cc121ca-a5ae-47ba-9fc3-9c32b7360790,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc121ca-a5')
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:5538c4ff-880a-4394-befe-795d914a5cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXYoMGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:17:15 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[219fc320-cf81-43ac-b7de-20964d3bc5c6]: Unexpected error while running command.
Nov 03 14:17:15 user nova-compute[74582]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 14:17:15 user nova-compute[74582]: Exit code: 21
Nov 03 14:17:15 user nova-compute[74582]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 14:17:15 user nova-compute[74582]: Stderr: '' {{(pid=85690) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 03 14:17:15 user nova-compute[74582]: Traceback (most recent call last):
Nov 03 14:17:15 user nova-compute[74582]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 03 14:17:15 user nova-compute[74582]:     ret = func(*f_args, **f_kwargs)
Nov 03 14:17:15 user nova-compute[74582]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 03 14:17:15 user nova-compute[74582]:     return func(*args, **kwargs)
Nov 03 14:17:15 user nova-compute[74582]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 03 14:17:15 user nova-compute[74582]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 03 14:17:15 user nova-compute[74582]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 03 14:17:15 user nova-compute[74582]:     return putils.execute(on_execute=on_execute,
Nov 03 14:17:15 user nova-compute[74582]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 03 14:17:15 user nova-compute[74582]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 03 14:17:15 user nova-compute[74582]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 03 14:17:15 user nova-compute[74582]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 14:17:15 user nova-compute[74582]: Exit code: 21
Nov 03 14:17:15 user nova-compute[74582]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 14:17:15 user nova-compute[74582]: Stderr: ''
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[219fc320-cf81-43ac-b7de-20964d3bc5c6]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 03 14:17:15 user nova-compute[74582]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 14:17:15 user nova-compute[74582]: Exit code: 21
Nov 03 14:17:15 user nova-compute[74582]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 14:17:15 user nova-compute[74582]: Stderr: ''
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 03 14:17:15 user nova-compute[74582]: ERROR os_brick.initiator.connectors.iscsi 
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74582) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== disconnect_volume: return (29ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:17:15 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Deletion of /opt/stack/data/nova/instances/c872e44a-e815-4f43-bbea-867d7a189c2e_del complete
Nov 03 14:17:15 user nova-compute[74582]: INFO nova.compute.manager [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Took 0.13 seconds to destroy the instance on the hypervisor.
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-40632720-81bd-458f-b172-f27fe5212ea5 req-5d029223-ee85-421e-9b80-ae816d03625e service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received event network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-40632720-81bd-458f-b172-f27fe5212ea5 req-5d029223-ee85-421e-9b80-ae816d03625e service nova] Acquiring lock "121a9119-b669-46f8-94e1-2336a2af437d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-40632720-81bd-458f-b172-f27fe5212ea5 req-5d029223-ee85-421e-9b80-ae816d03625e service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-40632720-81bd-458f-b172-f27fe5212ea5 req-5d029223-ee85-421e-9b80-ae816d03625e service nova] Lock "121a9119-b669-46f8-94e1-2336a2af437d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-40632720-81bd-458f-b172-f27fe5212ea5 req-5d029223-ee85-421e-9b80-ae816d03625e service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] No waiting events found dispatching network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:17:15 user nova-compute[74582]: WARNING nova.compute.manager [req-40632720-81bd-458f-b172-f27fe5212ea5 req-5d029223-ee85-421e-9b80-ae816d03625e service nova] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Received unexpected event network-vif-plugged-c85774cc-827c-495d-a145-464d1b18fa2d for instance with vm_state active and task_state deleting.
Nov 03 14:17:16 user nova-compute[74582]: INFO nova.compute.manager [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Took 0.94 seconds to detach 1 volumes for instance.
Nov 03 14:17:16 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 121a9119-b669-46f8-94e1-2336a2af437d] Deleting volume: 01aef467-6375-4d60-a84b-4e44c3c3bbed {{(pid=74582) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:16 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Deleted allocations for instance 121a9119-b669-46f8-94e1-2336a2af437d
Nov 03 14:17:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7de8e9bd-3939-402f-ac49-c21b74a6af1b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "121a9119-b669-46f8-94e1-2336a2af437d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.304s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:16 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:17:16 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Took 1.15 seconds to deallocate network for instance.
Nov 03 14:17:16 user nova-compute[74582]: INFO nova.compute.manager [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Took 0.12 seconds to detach 1 volumes for instance.
Nov 03 14:17:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:17 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:17:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-d7920b88-1bd4-4504-b568-5b33eaceaa68 req-65cc7fb8-abe2-4e86-bbea-e655d1da5e21 service nova] [instance: c872e44a-e815-4f43-bbea-867d7a189c2e] Received event network-vif-deleted-2cc121ca-a5ae-47ba-9fc3-9c32b7360790 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:17:17 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:17:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-593ee8dd-eb13-4236-b677-9403ce17ca8b tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "c872e44a-e815-4f43-bbea-867d7a189c2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:17:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:17:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:17:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:17:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8634MB free_disk=25.051979064941406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:17:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:17:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:17:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:17:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:17:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:17:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:17:59 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:17:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:17:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 1 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:17:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance has had 1 of 5 cleanup attempts {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 03 14:17:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deletion of /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize failed
Nov 03 14:18:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:18:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:18:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:18:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:18:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:11 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:18:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:18:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:18:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.04819107055664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:18:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:18:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:18:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:18:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:18:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:18:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:18:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "65fe94af-b734-4288-9e5f-c2431953790a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:18:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:18:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:18:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:18:48 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:18:48 user nova-compute[74582]: INFO nova.compute.claims [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Claim successful on node user
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.network.neutron [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:18:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:18:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.policy [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c726e17f780a483b8b3a220dfc34125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333545c5c61843ac89215bcc49b520e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:18:49 user nova-compute[74582]: INFO nova.virt.block_device [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Booting with volume 6b38c133-dd25-43ec-9a5f-7c6b57189168 at /dev/vda
Nov 03 14:18:49 user nova-compute[74582]: DEBUG os_brick.utils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf121d-f685-472f-923c-08fe3984c995]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fad7b57-cda0-4459-ad6a-c7b7e60e0a27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0799ae36-18ab-4dbe-88f7-fcb9c05de850]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f505d0-67f6-46c7-ada9-97de9826183b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:18:49 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:18:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507a273-cb40-4506-9beb-063c2d0ad2b4]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG os_brick.utils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:18:49 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating existing volume attachment record: 0fb1d6cd-7de3-4a52-a2e5-0964fbe3719f {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:18:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Successfully created port: 002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:18:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Successfully updated port: 002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:18:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:18:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquired lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:18:50 user nova-compute[74582]: DEBUG nova.network.neutron [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-changed-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Refreshing instance network info cache due to event network-changed-002a12b5-0892-47a8-83c6-05faeef47437. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] Acquiring lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG nova.network.neutron [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating instance_info_cache with network_info: [{"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Releasing lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Instance network_info: |[{"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] Acquired lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:18:51 user nova-compute[74582]: DEBUG nova.network.neutron [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Refreshing network info cache for port 002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:18:52 user nova-compute[74582]: DEBUG nova.network.neutron [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updated VIF entry in instance network info cache for port 002a12b5-0892-47a8-83c6-05faeef47437. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:18:52 user nova-compute[74582]: DEBUG nova.network.neutron [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating instance_info_cache with network_info: [{"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:18:52 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-43c357da-520a-4221-82ec-aacb0c26562d req-bebe0ff2-e631-4f7b-a2de-016331c0c157 service nova] Releasing lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:18:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:18:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:19:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Creating image(s)
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Ensure instance console log exists: /opt/stack/data/nova/instances/65fe94af-b734-4288-9e5f-c2431953790a/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Start _get_guest_xml network_info=[{"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0fb1d6cd-7de3-4a52-a2e5-0964fbe3719f', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zduHnxXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65fe94af-b734-4288-9e5f-c2431953790a', 'attached_at': '', 'detached_at': '', 'volume_id': '6b38c133-dd25-43ec-9a5f-7c6b57189168', 'serial': '6b38c133-dd25-43ec-9a5f-7c6b57189168'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:19:08 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:08 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zduHnxXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:19:08 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:19:08 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:19:08 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[edafd685-af3d-4b99-950a-b306731d1bda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:19:08 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cdc365-91af-40d7-b3f7-f7fb0de76db1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168] added
Nov 03 14:19:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[81709433-4e2f-443a-b17f-eb96447b5f1f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a5595-105f-4c9c-90ba-ed6af5c888ed]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zduHnxXf {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zduHnxXf" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e329cc-e373-4866-aa4c-7598a32d3428]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zduHnxXf'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2238c7f-2055-40a4-ab65-499b863c303f]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[26180201-d082-4095-bd2c-a628f330ee4b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 14:19:08 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 14:19:08 user nova-compute[74582]:  {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:19:08 user nova-compute[74582]: WARNING os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 14:19:08 user nova-compute[74582]: 
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fcae79-d289-4338-97fc-45eea2cc2a6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260]
Nov 03 14:19:08 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260] successful.
Nov 03 14:19:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1943f5a0-003f-4b95-b36a-d501c9ad4121]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a2db9b-ec9d-458a-9f39-c455d3ae1ddb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:19:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:19:08 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2f1bd-e6ab-4a8f-926c-2648c2c92422]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:08 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:19:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:19:09 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:19:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zduHnxXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:19:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:19:09 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26564336366626265', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:19:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564336366626265', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2060541675',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2060541675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2060541675',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+3A+6TyWC8ZDGjaoV2iK1w2MaLuS83cbOpZ8oo3wjbXvXL8FFYgRvnxyEpwbpLS6JQuuo5LUkCIRCItgDPVlhGB6J5lSVbKl0uzWCfxe5kK/l99j83hk2zPudaSQfnPw==',key_name='tempest-keypair-1052088659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-azdb12qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c726e17f780a483b8b3a220dfc34125d',uuid=65fe94af-b734-4288-9e5f-c2431953790a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.objects.instance [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'pci_devices' on Instance uuid 65fe94af-b734-4288-9e5f-c2431953790a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:19:10 user nova-compute[74582]:   <uuid>65fe94af-b734-4288-9e5f-c2431953790a</uuid>
Nov 03 14:19:10 user nova-compute[74582]:   <name>instance-0000002c</name>
Nov 03 14:19:10 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:19:10 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:19:10 user nova-compute[74582]:   <metadata>
Nov 03 14:19:10 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:19:10 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:19:10 user nova-compute[74582]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2060541675</nova:name>
Nov 03 14:19:10 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:19:08</nova:creationTime>
Nov 03 14:19:10 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:19:10 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:19:10 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:19:10 user nova-compute[74582]:       <nova:owner>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:user uuid="c726e17f780a483b8b3a220dfc34125d">tempest-TestVolumeBootPattern-1092687553-project-member</nova:user>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:project uuid="333545c5c61843ac89215bcc49b520e3">tempest-TestVolumeBootPattern-1092687553</nova:project>
Nov 03 14:19:10 user nova-compute[74582]:       </nova:owner>
Nov 03 14:19:10 user nova-compute[74582]:       <nova:ports>
Nov 03 14:19:10 user nova-compute[74582]:         <nova:port uuid="002a12b5-0892-47a8-83c6-05faeef47437">
Nov 03 14:19:10 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 14:19:10 user nova-compute[74582]:         </nova:port>
Nov 03 14:19:10 user nova-compute[74582]:       </nova:ports>
Nov 03 14:19:10 user nova-compute[74582]:     </nova:instance>
Nov 03 14:19:10 user nova-compute[74582]:   </metadata>
Nov 03 14:19:10 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:19:10 user nova-compute[74582]:     <system>
Nov 03 14:19:10 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:19:10 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:19:10 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:19:10 user nova-compute[74582]:       <entry name="serial">65fe94af-b734-4288-9e5f-c2431953790a</entry>
Nov 03 14:19:10 user nova-compute[74582]:       <entry name="uuid">65fe94af-b734-4288-9e5f-c2431953790a</entry>
Nov 03 14:19:10 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:19:10 user nova-compute[74582]:     </system>
Nov 03 14:19:10 user nova-compute[74582]:   </sysinfo>
Nov 03 14:19:10 user nova-compute[74582]:   <os>
Nov 03 14:19:10 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:19:10 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:19:10 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:19:10 user nova-compute[74582]:   </os>
Nov 03 14:19:10 user nova-compute[74582]:   <features>
Nov 03 14:19:10 user nova-compute[74582]:     <acpi/>
Nov 03 14:19:10 user nova-compute[74582]:     <apic/>
Nov 03 14:19:10 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:19:10 user nova-compute[74582]:   </features>
Nov 03 14:19:10 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:19:10 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:19:10 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:19:10 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:19:10 user nova-compute[74582]:   </clock>
Nov 03 14:19:10 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:19:10 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:19:10 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:19:10 user nova-compute[74582]:   </cpu>
Nov 03 14:19:10 user nova-compute[74582]:   <devices>
Nov 03 14:19:10 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:19:10 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:19:10 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 14:19:10 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:19:10 user nova-compute[74582]:       <serial>6b38c133-dd25-43ec-9a5f-7c6b57189168</serial>
Nov 03 14:19:10 user nova-compute[74582]:     </disk>
Nov 03 14:19:10 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:19:10 user nova-compute[74582]:       <mac address="fa:16:3e:08:5b:25"/>
Nov 03 14:19:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:19:10 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:19:10 user nova-compute[74582]:       <target dev="tap002a12b5-08"/>
Nov 03 14:19:10 user nova-compute[74582]:     </interface>
Nov 03 14:19:10 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:19:10 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/65fe94af-b734-4288-9e5f-c2431953790a/console.log" append="off"/>
Nov 03 14:19:10 user nova-compute[74582]:     </serial>
Nov 03 14:19:10 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:19:10 user nova-compute[74582]:     <video>
Nov 03 14:19:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:19:10 user nova-compute[74582]:     </video>
Nov 03 14:19:10 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:19:10 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:19:10 user nova-compute[74582]:     </rng>
Nov 03 14:19:10 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:19:10 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:19:10 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:19:10 user nova-compute[74582]:     </memballoon>
Nov 03 14:19:10 user nova-compute[74582]:   </devices>
Nov 03 14:19:10 user nova-compute[74582]: </domain>
Nov 03 14:19:10 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2060541675',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2060541675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2060541675',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+3A+6TyWC8ZDGjaoV2iK1w2MaLuS83cbOpZ8oo3wjbXvXL8FFYgRvnxyEpwbpLS6JQuuo5LUkCIRCItgDPVlhGB6J5lSVbKl0uzWCfxe5kK/l99j83hk2zPudaSQfnPw==',key_name='tempest-keypair-1052088659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-azdb12qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c726e17f780a483b8b3a220dfc34125d',uuid=65fe94af-b734-4288-9e5f-c2431953790a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG os_vif [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d52a4a8-c872-52f3-b790-727c14fec94d', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap002a12b5-08, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap002a12b5-08, col_values=(('qos', UUID('f5c5b462-89b6-4346-993f-b5f7f09c7487')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap002a12b5-08, col_values=(('external_ids', {'iface-id': '002a12b5-0892-47a8-83c6-05faeef47437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:5b:25', 'vm-uuid': '65fe94af-b734-4288-9e5f-c2431953790a'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:10 user nova-compute[74582]: INFO os_vif [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08')
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No VIF found with MAC fa:16:3e:08:5b:25, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:19:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-a86ee908-4321-4c93-b598-f6a151ec52fe req-bd80a703-a366-46b1-9825-3d3d2eac3cc9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a86ee908-4321-4c93-b598-f6a151ec52fe req-bd80a703-a366-46b1-9825-3d3d2eac3cc9 service nova] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a86ee908-4321-4c93-b598-f6a151ec52fe req-bd80a703-a366-46b1-9825-3d3d2eac3cc9 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a86ee908-4321-4c93-b598-f6a151ec52fe req-bd80a703-a366-46b1-9825-3d3d2eac3cc9 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-a86ee908-4321-4c93-b598-f6a151ec52fe req-bd80a703-a366-46b1-9825-3d3d2eac3cc9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] No waiting events found dispatching network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:11 user nova-compute[74582]: WARNING nova.compute.manager [req-a86ee908-4321-4c93-b598-f6a151ec52fe req-bd80a703-a366-46b1-9825-3d3d2eac3cc9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received unexpected event network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 for instance with vm_state building and task_state spawning.
Nov 03 14:19:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:19:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Instance spawned successfully.
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:13 user nova-compute[74582]: INFO nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:19:13 user nova-compute[74582]: INFO nova.compute.manager [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Took 25.08 seconds to build instance.
Nov 03 14:19:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-8a8035be-2af2-4514-b0b9-c7d8cb71d096 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "65fe94af-b734-4288-9e5f-c2431953790a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.185s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-7523d2d1-18a1-4f97-91df-e04aed795097 req-25a26677-8197-4b9e-9959-2589f1eda6f7 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7523d2d1-18a1-4f97-91df-e04aed795097 req-25a26677-8197-4b9e-9959-2589f1eda6f7 service nova] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7523d2d1-18a1-4f97-91df-e04aed795097 req-25a26677-8197-4b9e-9959-2589f1eda6f7 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7523d2d1-18a1-4f97-91df-e04aed795097 req-25a26677-8197-4b9e-9959-2589f1eda6f7 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-7523d2d1-18a1-4f97-91df-e04aed795097 req-25a26677-8197-4b9e-9959-2589f1eda6f7 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] No waiting events found dispatching network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:13 user nova-compute[74582]: WARNING nova.compute.manager [req-7523d2d1-18a1-4f97-91df-e04aed795097 req-25a26677-8197-4b9e-9959-2589f1eda6f7 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received unexpected event network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 for instance with vm_state active and task_state None.
Nov 03 14:19:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:18 user nova-compute[74582]: INFO nova.compute.manager [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Rescuing
Nov 03 14:19:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:19:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:19:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:19:18 user nova-compute[74582]: DEBUG nova.network.neutron [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:19:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.compute.manager [req-9ba893cc-69b3-4d32-95e0-960a4d98e8fe req-0546c4be-2b5b-499d-9b92-b0cdfeb32b70 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9ba893cc-69b3-4d32-95e0-960a4d98e8fe req-0546c4be-2b5b-499d-9b92-b0cdfeb32b70 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9ba893cc-69b3-4d32-95e0-960a4d98e8fe req-0546c4be-2b5b-499d-9b92-b0cdfeb32b70 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9ba893cc-69b3-4d32-95e0-960a4d98e8fe req-0546c4be-2b5b-499d-9b92-b0cdfeb32b70 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.compute.manager [req-9ba893cc-69b3-4d32-95e0-960a4d98e8fe req-0546c4be-2b5b-499d-9b92-b0cdfeb32b70 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:19 user nova-compute[74582]: WARNING nova.compute.manager [req-9ba893cc-69b3-4d32-95e0-960a4d98e8fe req-0546c4be-2b5b-499d-9b92-b0cdfeb32b70 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state active and task_state rescuing.
Nov 03 14:19:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance destroyed successfully.
Nov 03 14:19:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Attempting rescue
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74582) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 14:19:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Creating image(s)
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'trusted_certs' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue" returned: 0 in 0.061s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'migration_context' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.base [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<689c409d-9f60-4ad1-b9c1-5386c7a1bf8e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Start _get_guest_xml network_info=[{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:0d:35:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'resources' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.base [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<689c409d-9f60-4ad1-b9c1-5386c7a1bf8e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'numa_topology' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.base [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<689c409d-9f60-4ad1-b9c1-5386c7a1bf8e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:19:19 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:19 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.base [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<689c409d-9f60-4ad1-b9c1-5386c7a1bf8e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1500254791',display_name='tempest-ServerRescueNegativeTestJSON-server-1500254791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1500254791',id=41,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-4hil07kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:14:38Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=689c409d-9f60-4ad1-b9c1-5386c7a1bf8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:0d:35:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:0d:35:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:19:19 user nova-compute[74582]: DEBUG nova.objects.instance [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'pci_devices' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:20 user nova-compute[74582]: DEBUG nova.objects.base [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<689c409d-9f60-4ad1-b9c1-5386c7a1bf8e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:19:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:19:20 user nova-compute[74582]:   <uuid>689c409d-9f60-4ad1-b9c1-5386c7a1bf8e</uuid>
Nov 03 14:19:20 user nova-compute[74582]:   <name>instance-00000029</name>
Nov 03 14:19:20 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:19:20 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:19:20 user nova-compute[74582]:   <metadata>
Nov 03 14:19:20 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:19:20 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:19:20 user nova-compute[74582]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1500254791</nova:name>
Nov 03 14:19:20 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:19:19</nova:creationTime>
Nov 03 14:19:20 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:19:20 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:19:20 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:19:20 user nova-compute[74582]:       <nova:owner>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:user uuid="86cb25ef9de143a5a55d341a089e19de">tempest-ServerRescueNegativeTestJSON-1868952631-project-member</nova:user>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:project uuid="9f3f5290550c487fa7c35f987312a79b">tempest-ServerRescueNegativeTestJSON-1868952631</nova:project>
Nov 03 14:19:20 user nova-compute[74582]:       </nova:owner>
Nov 03 14:19:20 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:19:20 user nova-compute[74582]:       <nova:ports>
Nov 03 14:19:20 user nova-compute[74582]:         <nova:port uuid="499a267b-a845-4b95-8cbd-f6e718a553d6">
Nov 03 14:19:20 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 14:19:20 user nova-compute[74582]:         </nova:port>
Nov 03 14:19:20 user nova-compute[74582]:       </nova:ports>
Nov 03 14:19:20 user nova-compute[74582]:     </nova:instance>
Nov 03 14:19:20 user nova-compute[74582]:   </metadata>
Nov 03 14:19:20 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:19:20 user nova-compute[74582]:     <system>
Nov 03 14:19:20 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:19:20 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:19:20 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:19:20 user nova-compute[74582]:       <entry name="serial">689c409d-9f60-4ad1-b9c1-5386c7a1bf8e</entry>
Nov 03 14:19:20 user nova-compute[74582]:       <entry name="uuid">689c409d-9f60-4ad1-b9c1-5386c7a1bf8e</entry>
Nov 03 14:19:20 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:19:20 user nova-compute[74582]:     </system>
Nov 03 14:19:20 user nova-compute[74582]:   </sysinfo>
Nov 03 14:19:20 user nova-compute[74582]:   <os>
Nov 03 14:19:20 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:19:20 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:19:20 user nova-compute[74582]:   </os>
Nov 03 14:19:20 user nova-compute[74582]:   <features>
Nov 03 14:19:20 user nova-compute[74582]:     <acpi/>
Nov 03 14:19:20 user nova-compute[74582]:     <apic/>
Nov 03 14:19:20 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:19:20 user nova-compute[74582]:   </features>
Nov 03 14:19:20 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:19:20 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:19:20 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:19:20 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:19:20 user nova-compute[74582]:   </clock>
Nov 03 14:19:20 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:19:20 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:19:20 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:19:20 user nova-compute[74582]:   </cpu>
Nov 03 14:19:20 user nova-compute[74582]:   <devices>
Nov 03 14:19:20 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:19:20 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:19:20 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue"/>
Nov 03 14:19:20 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:19:20 user nova-compute[74582]:     </disk>
Nov 03 14:19:20 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:19:20 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:19:20 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk"/>
Nov 03 14:19:20 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:19:20 user nova-compute[74582]:     </disk>
Nov 03 14:19:20 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:19:20 user nova-compute[74582]:       <mac address="fa:16:3e:0d:35:54"/>
Nov 03 14:19:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:19:20 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:19:20 user nova-compute[74582]:       <target dev="tap499a267b-a8"/>
Nov 03 14:19:20 user nova-compute[74582]:     </interface>
Nov 03 14:19:20 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:19:20 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/console.log" append="off"/>
Nov 03 14:19:20 user nova-compute[74582]:     </serial>
Nov 03 14:19:20 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:19:20 user nova-compute[74582]:     <video>
Nov 03 14:19:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:19:20 user nova-compute[74582]:     </video>
Nov 03 14:19:20 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:19:20 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:19:20 user nova-compute[74582]:     </rng>
Nov 03 14:19:20 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:19:20 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:19:20 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:19:20 user nova-compute[74582]:     </memballoon>
Nov 03 14:19:20 user nova-compute[74582]:   </devices>
Nov 03 14:19:20 user nova-compute[74582]: </domain>
Nov 03 14:19:20 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:19:20 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance destroyed successfully.
Nov 03 14:19:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:19:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:19:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:0d:35:54, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:19:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-608be899-9721-4359-b1d2-3d79c8d9d7eb req-71ab7f80-4eb9-4ef8-b212-b727ea93e045 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-608be899-9721-4359-b1d2-3d79c8d9d7eb req-71ab7f80-4eb9-4ef8-b212-b727ea93e045 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-608be899-9721-4359-b1d2-3d79c8d9d7eb req-71ab7f80-4eb9-4ef8-b212-b727ea93e045 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-608be899-9721-4359-b1d2-3d79c8d9d7eb req-71ab7f80-4eb9-4ef8-b212-b727ea93e045 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-608be899-9721-4359-b1d2-3d79c8d9d7eb req-71ab7f80-4eb9-4ef8-b212-b727ea93e045 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:21 user nova-compute[74582]: WARNING nova.compute.manager [req-608be899-9721-4359-b1d2-3d79c8d9d7eb req-71ab7f80-4eb9-4ef8-b212-b727ea93e045 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state active and task_state rescuing.
Nov 03 14:19:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:23 user nova-compute[74582]: WARNING nova.compute.manager [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state active and task_state rescuing.
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:23 user nova-compute[74582]: WARNING nova.compute.manager [req-190e133a-4dbc-4701-8153-a27f14cde017 req-d56812a3-200f-4a3d-a7cf-219fb29df2e2 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state active and task_state rescuing.
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 14:19:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-f496f32a-5ab0-4da9-958d-4693d78c9156 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:28 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.035518646240234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 65fe94af-b734-4288-9e5f-c2431953790a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.321s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:28 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:19:28 user nova-compute[74582]: INFO nova.compute.claims [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Claim successful on node user
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:19:29 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.policy [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aff1acfbf504e3ca9fadaf662314da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d23e2540d949c28d9db7cffe3157ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:19:29 user nova-compute[74582]: INFO nova.virt.block_device [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Booting with volume 2aebd8cb-f6b4-4327-a35f-edaa9087c825 at /dev/vda
Nov 03 14:19:29 user nova-compute[74582]: DEBUG os_brick.utils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1701277-448d-42e9-9d01-033cb82f5628]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88963995-2c88-4677-9a61-e2bd53003c33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6494e78d-1293-4bbb-9360-0801b2e89e86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15197655-d4f2-47ca-84d3-66a0275af744]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:19:29 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:19:29 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73b6187-0cef-4e49-ac23-dca2b665afe0]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG os_brick.utils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:19:29 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating existing volume attachment record: a602c0e7-39ed-43fd-8398-aae0003a03d7 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:19:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:30 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Successfully created port: ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Successfully updated port: ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-changed-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.compute.manager [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Refreshing instance network info cache due to event network-changed-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance network_info: |[{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG nova.network.neutron [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Refreshing network info cache for port ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:19:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:32 user nova-compute[74582]: DEBUG nova.network.neutron [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updated VIF entry in instance network info cache for port ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:19:32 user nova-compute[74582]: DEBUG nova.network.neutron [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:19:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-833a9abf-303a-4ba7-99c2-3621e9661cc8 req-ca9e25c3-c3c2-41e6-850e-78714bfef73f service nova] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:19:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:19:50 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Creating image(s)
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Ensure instance console log exists: /opt/stack/data/nova/instances/1c523af7-444b-47ad-b421-e95fa4c3aa0c/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Start _get_guest_xml network_info=[{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a602c0e7-39ed-43fd-8398-aae0003a03d7', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c523af7-444b-47ad-b421-e95fa4c3aa0c', 'attached_at': '', 'detached_at': '', 'volume_id': '2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'serial': '2aebd8cb-f6b4-4327-a35f-edaa9087c825'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:19:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:50 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:19:50 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:19:50 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:19:50 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7959fa68-a5c2-49b3-ac41-148e50c037a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:19:50 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f7f7f-8305-4647-bbb0-07d033cb0b37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825] added
Nov 03 14:19:50 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:50 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[90baa994-9008-4186-b7da-a31602884a33]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92b492-2b78-4ea4-9257-249875cdbe3d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikbJyzYQ {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikbJyzYQ" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c665d-2e0f-427a-9b96-71ba9c1f0bff]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikbJyzYQ'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ddb37-c2ac-4d58-8a1c-47d38795d8b0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83159f4-4e86-41df-9e60-ebacb968e3d2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:19:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:19:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0daf47-dac0-445b-824a-437578127dac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]
Nov 03 14:19:51 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.
Nov 03 14:19:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[92edfae6-0815-4761-a2b5-5caaa0e5c7ef]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[911fc741-ea0c-4a6d-8aba-b411a36b5bf4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:19:51 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:19:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:19:51 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:19:51 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e2376a-a906-4b07-8163-dc9ce72de41c]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:19:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23037373665376534', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037373665376534', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2009884579',display_name='tempest-ServerActionsTestOtherA-server-2009884579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2009884579',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-bypgxfed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:19:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=1c523af7-444b-47ad-b421-e95fa4c3aa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c523af7-444b-47ad-b421-e95fa4c3aa0c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:19:52 user nova-compute[74582]:   <uuid>1c523af7-444b-47ad-b421-e95fa4c3aa0c</uuid>
Nov 03 14:19:52 user nova-compute[74582]:   <name>instance-0000002d</name>
Nov 03 14:19:52 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:19:52 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:19:52 user nova-compute[74582]:   <metadata>
Nov 03 14:19:52 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:19:52 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:19:52 user nova-compute[74582]:       <nova:name>tempest-ServerActionsTestOtherA-server-2009884579</nova:name>
Nov 03 14:19:52 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:19:50</nova:creationTime>
Nov 03 14:19:52 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:19:52 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:19:52 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:19:52 user nova-compute[74582]:       <nova:owner>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:user uuid="1aff1acfbf504e3ca9fadaf662314da0">tempest-ServerActionsTestOtherA-1486248520-project-member</nova:user>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:project uuid="89d23e2540d949c28d9db7cffe3157ac">tempest-ServerActionsTestOtherA-1486248520</nova:project>
Nov 03 14:19:52 user nova-compute[74582]:       </nova:owner>
Nov 03 14:19:52 user nova-compute[74582]:       <nova:ports>
Nov 03 14:19:52 user nova-compute[74582]:         <nova:port uuid="ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e">
Nov 03 14:19:52 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 14:19:52 user nova-compute[74582]:         </nova:port>
Nov 03 14:19:52 user nova-compute[74582]:       </nova:ports>
Nov 03 14:19:52 user nova-compute[74582]:     </nova:instance>
Nov 03 14:19:52 user nova-compute[74582]:   </metadata>
Nov 03 14:19:52 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:19:52 user nova-compute[74582]:     <system>
Nov 03 14:19:52 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:19:52 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:19:52 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:19:52 user nova-compute[74582]:       <entry name="serial">1c523af7-444b-47ad-b421-e95fa4c3aa0c</entry>
Nov 03 14:19:52 user nova-compute[74582]:       <entry name="uuid">1c523af7-444b-47ad-b421-e95fa4c3aa0c</entry>
Nov 03 14:19:52 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:19:52 user nova-compute[74582]:     </system>
Nov 03 14:19:52 user nova-compute[74582]:   </sysinfo>
Nov 03 14:19:52 user nova-compute[74582]:   <os>
Nov 03 14:19:52 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:19:52 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:19:52 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:19:52 user nova-compute[74582]:   </os>
Nov 03 14:19:52 user nova-compute[74582]:   <features>
Nov 03 14:19:52 user nova-compute[74582]:     <acpi/>
Nov 03 14:19:52 user nova-compute[74582]:     <apic/>
Nov 03 14:19:52 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:19:52 user nova-compute[74582]:   </features>
Nov 03 14:19:52 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:19:52 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:19:52 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:19:52 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:19:52 user nova-compute[74582]:   </clock>
Nov 03 14:19:52 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:19:52 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:19:52 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:19:52 user nova-compute[74582]:   </cpu>
Nov 03 14:19:52 user nova-compute[74582]:   <devices>
Nov 03 14:19:52 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:19:52 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:19:52 user nova-compute[74582]:       <source dev="/dev/sdc"/>
Nov 03 14:19:52 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:19:52 user nova-compute[74582]:       <serial>2aebd8cb-f6b4-4327-a35f-edaa9087c825</serial>
Nov 03 14:19:52 user nova-compute[74582]:     </disk>
Nov 03 14:19:52 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:19:52 user nova-compute[74582]:       <mac address="fa:16:3e:de:e5:9c"/>
Nov 03 14:19:52 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:19:52 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:19:52 user nova-compute[74582]:       <target dev="tapac4c6c74-ba"/>
Nov 03 14:19:52 user nova-compute[74582]:     </interface>
Nov 03 14:19:52 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:19:52 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/1c523af7-444b-47ad-b421-e95fa4c3aa0c/console.log" append="off"/>
Nov 03 14:19:52 user nova-compute[74582]:     </serial>
Nov 03 14:19:52 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:19:52 user nova-compute[74582]:     <video>
Nov 03 14:19:52 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:19:52 user nova-compute[74582]:     </video>
Nov 03 14:19:52 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:19:52 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:19:52 user nova-compute[74582]:     </rng>
Nov 03 14:19:52 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:19:52 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:19:52 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:19:52 user nova-compute[74582]:     </memballoon>
Nov 03 14:19:52 user nova-compute[74582]:   </devices>
Nov 03 14:19:52 user nova-compute[74582]: </domain>
Nov 03 14:19:52 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2009884579',display_name='tempest-ServerActionsTestOtherA-server-2009884579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2009884579',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-bypgxfed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:19:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=1c523af7-444b-47ad-b421-e95fa4c3aa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG os_vif [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0d5e87f-efff-5ea4-a358-3aa5e24db8b5', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac4c6c74-ba, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac4c6c74-ba, col_values=(('qos', UUID('6c08e897-9a68-4969-b9b5-3691162bcc35')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac4c6c74-ba, col_values=(('external_ids', {'iface-id': 'ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:e5:9c', 'vm-uuid': '1c523af7-444b-47ad-b421-e95fa4c3aa0c'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:52 user nova-compute[74582]: INFO os_vif [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba')
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:19:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No VIF found with MAC fa:16:3e:de:e5:9c, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b1668010-d7d2-4aa9-948e-ed07018f53e0 req-8fd43f93-06a4-436c-bcba-426e0849d3c1 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b1668010-d7d2-4aa9-948e-ed07018f53e0 req-8fd43f93-06a4-436c-bcba-426e0849d3c1 service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b1668010-d7d2-4aa9-948e-ed07018f53e0 req-8fd43f93-06a4-436c-bcba-426e0849d3c1 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b1668010-d7d2-4aa9-948e-ed07018f53e0 req-8fd43f93-06a4-436c-bcba-426e0849d3c1 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-b1668010-d7d2-4aa9-948e-ed07018f53e0 req-8fd43f93-06a4-436c-bcba-426e0849d3c1 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:53 user nova-compute[74582]: WARNING nova.compute.manager [req-b1668010-d7d2-4aa9-948e-ed07018f53e0 req-8fd43f93-06a4-436c-bcba-426e0849d3c1 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state building and task_state spawning.
Nov 03 14:19:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:19:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance spawned successfully.
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-289b592f-b827-422c-85de-3cbcc2e17b95 req-920c5e5c-a1a7-42f6-a374-99e4a5dfd358 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-289b592f-b827-422c-85de-3cbcc2e17b95 req-920c5e5c-a1a7-42f6-a374-99e4a5dfd358 service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-289b592f-b827-422c-85de-3cbcc2e17b95 req-920c5e5c-a1a7-42f6-a374-99e4a5dfd358 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-289b592f-b827-422c-85de-3cbcc2e17b95 req-920c5e5c-a1a7-42f6-a374-99e4a5dfd358 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.compute.manager [req-289b592f-b827-422c-85de-3cbcc2e17b95 req-920c5e5c-a1a7-42f6-a374-99e4a5dfd358 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:19:55 user nova-compute[74582]: WARNING nova.compute.manager [req-289b592f-b827-422c-85de-3cbcc2e17b95 req-920c5e5c-a1a7-42f6-a374-99e4a5dfd358 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state building and task_state spawning.
Nov 03 14:19:55 user nova-compute[74582]: INFO nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 03 14:19:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:19:56 user nova-compute[74582]: INFO nova.compute.manager [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Took 27.58 seconds to build instance.
Nov 03 14:19:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e1d34dc8-2224-4050-97be-5fb0a307f1a9 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.766s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:19:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:19:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:20:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:20:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:20:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:20:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:20:27 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:20:27 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8285MB free_disk=25.024158477783203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 65fe94af-b734-4288-9e5f-c2431953790a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:20:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:20:28 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:20:28 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:20:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:20:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:20:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:20:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:20:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-changed-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:20:39 user nova-compute[74582]: DEBUG nova.compute.manager [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Refreshing instance network info cache due to event network-changed-002a12b5-0892-47a8-83c6-05faeef47437. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:20:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] Acquiring lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:20:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] Acquired lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:20:39 user nova-compute[74582]: DEBUG nova.network.neutron [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Refreshing network info cache for port 002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:20:40 user nova-compute[74582]: DEBUG nova.network.neutron [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updated VIF entry in instance network info cache for port 002a12b5-0892-47a8-83c6-05faeef47437. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:20:40 user nova-compute[74582]: DEBUG nova.network.neutron [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating instance_info_cache with network_info: [{"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:20:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b8fd548c-809c-418d-a413-e84b822b77c3 req-7cc5a925-5f8b-465e-a122-a4b164e0c691 service nova] Releasing lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:20:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:20:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:20:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:20:55 user nova-compute[74582]: INFO nova.compute.claims [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Claim successful on node user
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:20:55 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:20:55 user nova-compute[74582]: DEBUG nova.policy [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c726e17f780a483b8b3a220dfc34125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333545c5c61843ac89215bcc49b520e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:20:55 user nova-compute[74582]: INFO nova.virt.block_device [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Booting with volume snapshot 264d5444-876d-4462-a62d-a5e433445bd2 at /dev/vda
Nov 03 14:20:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Successfully created port: 5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Successfully updated port: 5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquired lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-changed-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Refreshing instance network info cache due to event network-changed-5550dfb1-406d-49f3-9d79-a780fbeb7595. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] Acquiring lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:20:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG nova.network.neutron [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updating instance_info_cache with network_info: [{"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Releasing lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Instance network_info: |[{"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] Acquired lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Refreshing network info cache for port 5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updated VIF entry in instance network info cache for port 5550dfb1-406d-49f3-9d79-a780fbeb7595. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updating instance_info_cache with network_info: [{"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:20:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dd69d333-9fee-4d44-ac3a-045615b430f0 req-04f8aff9-ee9a-41e5-aa6e-50a76363886a service nova] Releasing lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG os_brick.utils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4816eba-d775-4d10-afc3-ed6074288196]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b0f062-7d3f-4432-b4ab-469a28fa8bcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a09455a-5068-4b54-87d6-1bb70811572f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50936c-40f9-4e90-8124-18ff4e13cad9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:21:01 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:21:01 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[190a81c9-9d17-44ab-b1f0-a06147a46b1f]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG os_brick.utils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:21:01 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updating existing volume attachment record: 9672d9ef-4459-409f-a007-7dc107e64724 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:21:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:21:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:21:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:21:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:09 user nova-compute[74582]: INFO nova.compute.manager [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Unrescuing
Nov 03 14:21:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG nova.objects.instance [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'flavor' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG nova.compute.manager [req-3611cbba-dcfc-490a-86d7-c610e724a017 req-88b460ec-e671-49a9-aab4-191fbb91c882 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3611cbba-dcfc-490a-86d7-c610e724a017 req-88b460ec-e671-49a9-aab4-191fbb91c882 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3611cbba-dcfc-490a-86d7-c610e724a017 req-88b460ec-e671-49a9-aab4-191fbb91c882 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3611cbba-dcfc-490a-86d7-c610e724a017 req-88b460ec-e671-49a9-aab4-191fbb91c882 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG nova.compute.manager [req-3611cbba-dcfc-490a-86d7-c610e724a017 req-88b460ec-e671-49a9-aab4-191fbb91c882 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:09 user nova-compute[74582]: WARNING nova.compute.manager [req-3611cbba-dcfc-490a-86d7-c610e724a017 req-88b460ec-e671-49a9-aab4-191fbb91c882 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:21:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:10 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:10 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance destroyed successfully.
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:11 user nova-compute[74582]: WARNING nova.compute.manager [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:21:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:11 user nova-compute[74582]: WARNING nova.compute.manager [req-dddd8e65-710a-4209-b5d9-97f3a12f899e req-a19fe700-a290-41b6-a5d9-b2c678471883 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:21:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:12 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:21:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-7be5d6b9-5e10-4206-8a7c-d4fbe96b7016 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:21:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-bcf5481b-c473-4e1c-9cb0-9ed958d04370 req-4d6c6c54-a3eb-425e-b1c5-8f4d7ee3132b service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bcf5481b-c473-4e1c-9cb0-9ed958d04370 req-4d6c6c54-a3eb-425e-b1c5-8f4d7ee3132b service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bcf5481b-c473-4e1c-9cb0-9ed958d04370 req-4d6c6c54-a3eb-425e-b1c5-8f4d7ee3132b service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bcf5481b-c473-4e1c-9cb0-9ed958d04370 req-4d6c6c54-a3eb-425e-b1c5-8f4d7ee3132b service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-bcf5481b-c473-4e1c-9cb0-9ed958d04370 req-4d6c6c54-a3eb-425e-b1c5-8f4d7ee3132b service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:14 user nova-compute[74582]: WARNING nova.compute.manager [req-bcf5481b-c473-4e1c-9cb0-9ed958d04370 req-4d6c6c54-a3eb-425e-b1c5-8f4d7ee3132b service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state active and task_state None.
Nov 03 14:21:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-changed-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Refreshing instance network info cache due to event network-changed-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:21:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:21:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:21:18 user nova-compute[74582]: DEBUG nova.network.neutron [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Refreshing network info cache for port 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:21:19 user nova-compute[74582]: DEBUG nova.network.neutron [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated VIF entry in instance network info cache for port 400ba332-96ca-4bf2-9c81-f2a4acd7c6a9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:21:19 user nova-compute[74582]: DEBUG nova.network.neutron [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:21:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7036cf0d-9edb-4d45-992e-1d5c1363bda7 req-65996d45-5e5c-4399-a20a-a2165efc8b1a service nova] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-changed-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Refreshing instance network info cache due to event network-changed-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Refreshing network info cache for port ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.compute.manager [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Stashing vm_state: active {{(pid=74582) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:21:21 user nova-compute[74582]: INFO nova.compute.claims [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Claim successful on node user
Nov 03 14:21:21 user nova-compute[74582]: INFO nova.compute.resource_tracker [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating resource usage from migration de6b4458-21e1-40c7-9611-0ce010fc1d04
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updated VIF entry in instance network info cache for port ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.network.neutron [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e2fbdf5-cdf7-4e65-9eac-022afb6f52c2 req-c2f2c16e-52d3-48db-a845-addaf9a9a5fa service nova] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.449s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:21 user nova-compute[74582]: INFO nova.compute.manager [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Migrating
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:21:21 user nova-compute[74582]: DEBUG nova.network.neutron [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:21:22 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Creating image(s)
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Ensure instance console log exists: /opt/stack/data/nova/instances/ae0264f5-79d7-4e75-82ee-bc0a22d9908f/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Start _get_guest_xml network_info=[{"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T14:20:41Z,direct_url=<?>,disk_format='qcow2',id=ec3608a5-571a-4fd5-a6b3-2c26f38d8118,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1024464099',owner='333545c5c61843ac89215bcc49b520e3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T14:20:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9672d9ef-4459-409f-a007-7dc107e64724', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGAHoWDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae0264f5-79d7-4e75-82ee-bc0a22d9908f', 'attached_at': '', 'detached_at': '', 'volume_id': 'be8ca20a-ec4d-438b-8120-7038882fa3be', 'serial': 'be8ca20a-ec4d-438b-8120-7038882fa3be'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:21:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:21:22 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T14:20:41Z,direct_url=<?>,disk_format='qcow2',id=ec3608a5-571a-4fd5-a6b3-2c26f38d8118,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1024464099',owner='333545c5c61843ac89215bcc49b520e3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T14:20:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGAHoWDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:21:22 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:21:22 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:21:22 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[292ee58d-3328-4221-b1bb-f642972b5a6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:21:22 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5132fe-b2bc-4e5a-9072-f01ac2d5929b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be] added
Nov 03 14:21:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd1f8b1-c890-4343-883a-f05638434435]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b72bac-a154-44cd-87b3-dbf7c304cad9]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGAHoWDM {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGAHoWDM" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6b4f05-5761-4b7a-a648-05ba1550d392]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kGAHoWDM'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b86bbc-0008-4b06-be17-8533f633db55]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[605778c3-4306-4f6e-af6c-5ee01082ec12]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[765a1bcc-9e15-4d56-915b-eac09e44a123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260]
Nov 03 14:21:22 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260] successful.
Nov 03 14:21:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec91c94-8454-45c2-a9fa-b69bef7989be]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56ae103-2a0d-4554-8ee3-ba3746998632]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:22 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:22 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.network.neutron [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[967ac67a-f470-47ac-bb27-594714623f40]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Starting migrate_disk_and_power_off {{(pid=74582) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-f221164e-91a4-4196-bc4d-a4dc036fd2fc req-9d2df4b8-ff88-49a6-a717-da899dc8e573 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f221164e-91a4-4196-bc4d-a4dc036fd2fc req-9d2df4b8-ff88-49a6-a717-da899dc8e573 service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f221164e-91a4-4196-bc4d-a4dc036fd2fc req-9d2df4b8-ff88-49a6-a717-da899dc8e573 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f221164e-91a4-4196-bc4d-a4dc036fd2fc req-9d2df4b8-ff88-49a6-a717-da899dc8e573 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-f221164e-91a4-4196-bc4d-a4dc036fd2fc req-9d2df4b8-ff88-49a6-a717-da899dc8e573 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:22 user nova-compute[74582]: WARNING nova.compute.manager [req-f221164e-91a4-4196-bc4d-a4dc036fd2fc req-9d2df4b8-ff88-49a6-a717-da899dc8e573 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_migrating.
Nov 03 14:21:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance destroyed successfully.
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2009884579',display_name='tempest-ServerActionsTestOtherA-server-2009884579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2009884579',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-bypgxfed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:21:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=1c523af7-444b-47ad-b421-e95fa4c3aa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac4c6c74-ba, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c08e897-9a68-4969-b9b5-3691162bcc35) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGAHoWDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23161393165383238', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161393165383238', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:23 user nova-compute[74582]: INFO os_vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba')
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:21:23 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da207d-33f9-43a2-9335-b46700fd286e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:21:23 user nova-compute[74582]: No targets found.
Nov 03 14:21:23 user nova-compute[74582]: iSNS:
Nov 03 14:21:23 user nova-compute[74582]: No targets found.
Nov 03 14:21:23 user nova-compute[74582]: STATIC:
Nov 03 14:21:23 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168
Nov 03 14:21:23 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:21:23 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:21:23 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be
Nov 03 14:21:23 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:21:23 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:21:23 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825
Nov 03 14:21:23 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:21:23 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:21:23 user nova-compute[74582]: FIRMWARE:
Nov 03 14:21:23 user nova-compute[74582]: No targets found.
Nov 03 14:21:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:21:23 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:21:23 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1571350730',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1571350730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1571350730',id=46,image_ref='ec3608a5-571a-4fd5-a6b3-2c26f38d8118',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmwN7OCTGnPMHkdzKniSoYBlmERwBF/cNKF21JgUjZxSFLjztxzXwIXAm1fVUyf5FEWaILB09LJqPz+7K/JTrawu2RByD2leEH1M8zDCLFBpb6/srSZPSSa5wEUXAWkyw==',key_name='tempest-keypair-1986456761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-al8ngxee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1092687553',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:20:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c726e17f780a483b8b3a220dfc34125d',uuid=ae0264f5-79d7-4e75-82ee-bc0a22d9908f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.objects.instance [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'pci_devices' on Instance uuid ae0264f5-79d7-4e75-82ee-bc0a22d9908f {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:21:23 user nova-compute[74582]:   <uuid>ae0264f5-79d7-4e75-82ee-bc0a22d9908f</uuid>
Nov 03 14:21:23 user nova-compute[74582]:   <name>instance-0000002e</name>
Nov 03 14:21:23 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:21:23 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:21:23 user nova-compute[74582]:   <metadata>
Nov 03 14:21:23 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:21:23 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:21:23 user nova-compute[74582]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1571350730</nova:name>
Nov 03 14:21:23 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:21:22</nova:creationTime>
Nov 03 14:21:23 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:21:23 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:21:23 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:21:23 user nova-compute[74582]:       <nova:owner>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:user uuid="c726e17f780a483b8b3a220dfc34125d">tempest-TestVolumeBootPattern-1092687553-project-member</nova:user>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:project uuid="333545c5c61843ac89215bcc49b520e3">tempest-TestVolumeBootPattern-1092687553</nova:project>
Nov 03 14:21:23 user nova-compute[74582]:       </nova:owner>
Nov 03 14:21:23 user nova-compute[74582]:       <nova:root type="image" uuid="ec3608a5-571a-4fd5-a6b3-2c26f38d8118"/>
Nov 03 14:21:23 user nova-compute[74582]:       <nova:ports>
Nov 03 14:21:23 user nova-compute[74582]:         <nova:port uuid="5550dfb1-406d-49f3-9d79-a780fbeb7595">
Nov 03 14:21:23 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 14:21:23 user nova-compute[74582]:         </nova:port>
Nov 03 14:21:23 user nova-compute[74582]:       </nova:ports>
Nov 03 14:21:23 user nova-compute[74582]:     </nova:instance>
Nov 03 14:21:23 user nova-compute[74582]:   </metadata>
Nov 03 14:21:23 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:21:23 user nova-compute[74582]:     <system>
Nov 03 14:21:23 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:21:23 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:21:23 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:21:23 user nova-compute[74582]:       <entry name="serial">ae0264f5-79d7-4e75-82ee-bc0a22d9908f</entry>
Nov 03 14:21:23 user nova-compute[74582]:       <entry name="uuid">ae0264f5-79d7-4e75-82ee-bc0a22d9908f</entry>
Nov 03 14:21:23 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:21:23 user nova-compute[74582]:     </system>
Nov 03 14:21:23 user nova-compute[74582]:   </sysinfo>
Nov 03 14:21:23 user nova-compute[74582]:   <os>
Nov 03 14:21:23 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:21:23 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:21:23 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:21:23 user nova-compute[74582]:   </os>
Nov 03 14:21:23 user nova-compute[74582]:   <features>
Nov 03 14:21:23 user nova-compute[74582]:     <acpi/>
Nov 03 14:21:23 user nova-compute[74582]:     <apic/>
Nov 03 14:21:23 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:21:23 user nova-compute[74582]:   </features>
Nov 03 14:21:23 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:21:23 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:21:23 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:21:23 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:21:23 user nova-compute[74582]:   </clock>
Nov 03 14:21:23 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:21:23 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:21:23 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:21:23 user nova-compute[74582]:   </cpu>
Nov 03 14:21:23 user nova-compute[74582]:   <devices>
Nov 03 14:21:23 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:21:23 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:21:23 user nova-compute[74582]:       <source dev="/dev/sdd"/>
Nov 03 14:21:23 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:21:23 user nova-compute[74582]:       <serial>be8ca20a-ec4d-438b-8120-7038882fa3be</serial>
Nov 03 14:21:23 user nova-compute[74582]:     </disk>
Nov 03 14:21:23 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:21:23 user nova-compute[74582]:       <mac address="fa:16:3e:db:a6:f0"/>
Nov 03 14:21:23 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:21:23 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:21:23 user nova-compute[74582]:       <target dev="tap5550dfb1-40"/>
Nov 03 14:21:23 user nova-compute[74582]:     </interface>
Nov 03 14:21:23 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:21:23 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/ae0264f5-79d7-4e75-82ee-bc0a22d9908f/console.log" append="off"/>
Nov 03 14:21:23 user nova-compute[74582]:     </serial>
Nov 03 14:21:23 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:21:23 user nova-compute[74582]:     <video>
Nov 03 14:21:23 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:21:23 user nova-compute[74582]:     </video>
Nov 03 14:21:23 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:21:23 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:21:23 user nova-compute[74582]:     </rng>
Nov 03 14:21:23 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:21:23 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:21:23 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:21:23 user nova-compute[74582]:     </memballoon>
Nov 03 14:21:23 user nova-compute[74582]:   </devices>
Nov 03 14:21:23 user nova-compute[74582]: </domain>
Nov 03 14:21:23 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1571350730',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1571350730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1571350730',id=46,image_ref='ec3608a5-571a-4fd5-a6b3-2c26f38d8118',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmwN7OCTGnPMHkdzKniSoYBlmERwBF/cNKF21JgUjZxSFLjztxzXwIXAm1fVUyf5FEWaILB09LJqPz+7K/JTrawu2RByD2leEH1M8zDCLFBpb6/srSZPSSa5wEUXAWkyw==',key_name='tempest-keypair-1986456761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-al8ngxee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1092687553',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:20:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c726e17f780a483b8b3a220dfc34125d',uuid=ae0264f5-79d7-4e75-82ee-bc0a22d9908f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_vif [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4243a80e-e6b7-44f9-9bc6-d034ba2291b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a29629ad-be72-52f5-8185-6795b1f026c2', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5550dfb1-40, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5550dfb1-40, col_values=(('qos', UUID('b603135e-f16e-486e-af14-b776551b6d1a')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5550dfb1-40, col_values=(('external_ids', {'iface-id': '5550dfb1-406d-49f3-9d79-a780fbeb7595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:a6:f0', 'vm-uuid': 'ae0264f5-79d7-4e75-82ee-bc0a22d9908f'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ff8052-5f7f-4f99-9057-3a88353a2b51]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:23 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:23 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:23 user nova-compute[74582]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:23 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f48742a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: INFO os_vif [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40')
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f829d4-de9c-47f8-8bd2-f30f784e968b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11600f49-6030-4652-9af4-3c17cc148ea8]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No VIF found with MAC fa:16:3e:db:a6:f0, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c501852-d6dd-4644-b416-e8cd7e065da1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[120329b8-81ea-43cf-a340-b971fba03a66]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ef664a-3562-4791-9ae6-264cd492c4fb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a4256-f01e-48aa-b9ec-d74251f26000]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]
Nov 03 14:21:23 user nova-compute[74582]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.
Nov 03 14:21:23 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5c08f-1273-4191-b436-a5259556e09b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== disconnect_volume: return (348ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:25 user nova-compute[74582]: WARNING nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_migrating.
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:25 user nova-compute[74582]: WARNING nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_migrating.
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:25 user nova-compute[74582]: WARNING nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_migrating.
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:25 user nova-compute[74582]: WARNING nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_migrating.
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:25 user nova-compute[74582]: WARNING nova.compute.manager [req-10340b34-0822-444f-bba2-030aa50ab861 req-6d8212bd-7ad2-4ab3-9767-99e81884c19e service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_migrating.
Nov 03 14:21:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Port ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e binding to destination host user is already ACTIVE {{(pid=74582) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-994b4c4c-8902-4029-a3e7-0e6d6dc1de84 req-36bdf8b9-a6fe-44dc-add4-d1174451e929 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-994b4c4c-8902-4029-a3e7-0e6d6dc1de84 req-36bdf8b9-a6fe-44dc-add4-d1174451e929 service nova] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-994b4c4c-8902-4029-a3e7-0e6d6dc1de84 req-36bdf8b9-a6fe-44dc-add4-d1174451e929 service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-994b4c4c-8902-4029-a3e7-0e6d6dc1de84 req-36bdf8b9-a6fe-44dc-add4-d1174451e929 service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.compute.manager [req-994b4c4c-8902-4029-a3e7-0e6d6dc1de84 req-36bdf8b9-a6fe-44dc-add4-d1174451e929 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] No waiting events found dispatching network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:25 user nova-compute[74582]: WARNING nova.compute.manager [req-994b4c4c-8902-4029-a3e7-0e6d6dc1de84 req-36bdf8b9-a6fe-44dc-add4-d1174451e929 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received unexpected event network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 for instance with vm_state building and task_state spawning.
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG nova.network.neutron [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:21:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG os_brick.utils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7fbf51-23fd-4952-bfe3-6a64e07558b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ffde37-1697-4ca8-bc8a-43a2e437d82b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b366f993-e552-48ec-9640-fdff3b670786]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5a6f3-fb6d-4d33-9598-d1b8b99273dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:21:26 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836cbaa-b288-4115-bba4-a132d228ddba]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG os_brick.utils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:21:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:21:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Instance spawned successfully.
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-ce2bd215-03fb-417c-8c3d-183d09cda42e req-1edcb9ba-eb88-452c-8618-ecf8f56248ab service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ce2bd215-03fb-417c-8c3d-183d09cda42e req-1edcb9ba-eb88-452c-8618-ecf8f56248ab service nova] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ce2bd215-03fb-417c-8c3d-183d09cda42e req-1edcb9ba-eb88-452c-8618-ecf8f56248ab service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ce2bd215-03fb-417c-8c3d-183d09cda42e req-1edcb9ba-eb88-452c-8618-ecf8f56248ab service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-ce2bd215-03fb-417c-8c3d-183d09cda42e req-1edcb9ba-eb88-452c-8618-ecf8f56248ab service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] No waiting events found dispatching network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:27 user nova-compute[74582]: WARNING nova.compute.manager [req-ce2bd215-03fb-417c-8c3d-183d09cda42e req-1edcb9ba-eb88-452c-8618-ecf8f56248ab service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received unexpected event network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 for instance with vm_state building and task_state spawning.
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:21:27 user nova-compute[74582]: INFO nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:21:27 user nova-compute[74582]: INFO nova.compute.manager [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Took 32.43 seconds to build instance.
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-799a71ce-8439-4715-94b2-85d71e810726 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.536s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:21:29 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:21:29 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.019737243652344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Applying migration context for instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c as it has an incoming, in-progress migration de6b4458-21e1-40c7-9611-0ce010fc1d04. Migration status is post-migrating {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 14:21:29 user nova-compute[74582]: INFO nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating resource usage from migration de6b4458-21e1-40c7-9611-0ce010fc1d04
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 65fe94af-b734-4288-9e5f-c2431953790a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ae0264f5-79d7-4e75-82ee-bc0a22d9908f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Migration de6b4458-21e1-40c7-9611-0ce010fc1d04 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:21:29 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:21:30 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:21:30 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:21:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:21:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Starting finish_migration {{(pid=74582) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 14:21:46 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Creating image(s)
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Ensure instance console log exists: /opt/stack/data/nova/instances/1c523af7-444b-47ad-b421-e95fa4c3aa0c/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Start _get_guest_xml network_info=[{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cdb8cd5d-d5e2-4099-b016-008d0bcbc983', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1c523af7-444b-47ad-b421-e95fa4c3aa0c', 'attached_at': '2023-11-03T14:21:47.000000', 'detached_at': '', 'volume_id': '2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'serial': '2aebd8cb-f6b4-4327-a35f-edaa9087c825'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:21:46 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:21:46 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:21:46 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:21:46 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:21:46 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecc2db2-c787-47e6-a224-329396c2b3b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:21:46 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e315c9-e410-4232-9513-550e89a06685]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825] added
Nov 03 14:21:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fcc5bb-0efc-4b0b-8f0b-a1903b38917b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[415190a7-c8e1-4f1c-813d-bc636f8d03ce]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikbJyzYQ {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikbJyzYQ" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[07555f68-3f0b-4dd4-99a8-12aa6ddb536d]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikbJyzYQ'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[38000c7d-6138-43c9-9e20-06d7fff11b0b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab260c-143b-4c25-a3df-d0cc5eea1dc5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:46 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:46 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff47e8b-29b2-42f7-bc45-750ef0b939aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]
Nov 03 14:21:46 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.
Nov 03 14:21:46 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:46 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4190251-c117-48c1-b6d8-321de009e297]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[deffa87a-323b-44c8-bdc5-b8af21f4b0c4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:47 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:47 user nova-compute[74582]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:21:47 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:21:47 user nova-compute[74582]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:21:47 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8da0f10-4338-4d87-99d1-e477d63044ab]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:21:47 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23037373665376534', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037373665376534', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2009884579',display_name='tempest-ServerActionsTestOtherA-server-2009884579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2009884579',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-bypgxfed',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=1c523af7-444b-47ad-b421-e95fa4c3aa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:21:48 user nova-compute[74582]:   <uuid>1c523af7-444b-47ad-b421-e95fa4c3aa0c</uuid>
Nov 03 14:21:48 user nova-compute[74582]:   <name>instance-0000002d</name>
Nov 03 14:21:48 user nova-compute[74582]:   <memory>2097152</memory>
Nov 03 14:21:48 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:21:48 user nova-compute[74582]:   <metadata>
Nov 03 14:21:48 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:21:48 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:21:48 user nova-compute[74582]:       <nova:name>tempest-ServerActionsTestOtherA-server-2009884579</nova:name>
Nov 03 14:21:48 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:21:46</nova:creationTime>
Nov 03 14:21:48 user nova-compute[74582]:       <nova:flavor name="m1.small">
Nov 03 14:21:48 user nova-compute[74582]:         <nova:memory>2048</nova:memory>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:disk>20</nova:disk>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:21:48 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:21:48 user nova-compute[74582]:       <nova:owner>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:user uuid="1aff1acfbf504e3ca9fadaf662314da0">tempest-ServerActionsTestOtherA-1486248520-project-member</nova:user>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:project uuid="89d23e2540d949c28d9db7cffe3157ac">tempest-ServerActionsTestOtherA-1486248520</nova:project>
Nov 03 14:21:48 user nova-compute[74582]:       </nova:owner>
Nov 03 14:21:48 user nova-compute[74582]:       <nova:ports>
Nov 03 14:21:48 user nova-compute[74582]:         <nova:port uuid="ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e">
Nov 03 14:21:48 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 14:21:48 user nova-compute[74582]:         </nova:port>
Nov 03 14:21:48 user nova-compute[74582]:       </nova:ports>
Nov 03 14:21:48 user nova-compute[74582]:     </nova:instance>
Nov 03 14:21:48 user nova-compute[74582]:   </metadata>
Nov 03 14:21:48 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:21:48 user nova-compute[74582]:     <system>
Nov 03 14:21:48 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:21:48 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:21:48 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:21:48 user nova-compute[74582]:       <entry name="serial">1c523af7-444b-47ad-b421-e95fa4c3aa0c</entry>
Nov 03 14:21:48 user nova-compute[74582]:       <entry name="uuid">1c523af7-444b-47ad-b421-e95fa4c3aa0c</entry>
Nov 03 14:21:48 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:21:48 user nova-compute[74582]:     </system>
Nov 03 14:21:48 user nova-compute[74582]:   </sysinfo>
Nov 03 14:21:48 user nova-compute[74582]:   <os>
Nov 03 14:21:48 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:21:48 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:21:48 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:21:48 user nova-compute[74582]:   </os>
Nov 03 14:21:48 user nova-compute[74582]:   <features>
Nov 03 14:21:48 user nova-compute[74582]:     <acpi/>
Nov 03 14:21:48 user nova-compute[74582]:     <apic/>
Nov 03 14:21:48 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:21:48 user nova-compute[74582]:   </features>
Nov 03 14:21:48 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:21:48 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:21:48 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:21:48 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:21:48 user nova-compute[74582]:   </clock>
Nov 03 14:21:48 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:21:48 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:21:48 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:21:48 user nova-compute[74582]:   </cpu>
Nov 03 14:21:48 user nova-compute[74582]:   <devices>
Nov 03 14:21:48 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:21:48 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:21:48 user nova-compute[74582]:       <source dev="/dev/sdc"/>
Nov 03 14:21:48 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:21:48 user nova-compute[74582]:       <serial>2aebd8cb-f6b4-4327-a35f-edaa9087c825</serial>
Nov 03 14:21:48 user nova-compute[74582]:     </disk>
Nov 03 14:21:48 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:21:48 user nova-compute[74582]:       <mac address="fa:16:3e:de:e5:9c"/>
Nov 03 14:21:48 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:21:48 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:21:48 user nova-compute[74582]:       <target dev="tapac4c6c74-ba"/>
Nov 03 14:21:48 user nova-compute[74582]:     </interface>
Nov 03 14:21:48 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:21:48 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/1c523af7-444b-47ad-b421-e95fa4c3aa0c/console.log" append="off"/>
Nov 03 14:21:48 user nova-compute[74582]:     </serial>
Nov 03 14:21:48 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:21:48 user nova-compute[74582]:     <video>
Nov 03 14:21:48 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:21:48 user nova-compute[74582]:     </video>
Nov 03 14:21:48 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:21:48 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:21:48 user nova-compute[74582]:     </rng>
Nov 03 14:21:48 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:21:48 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:21:48 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:21:48 user nova-compute[74582]:     </memballoon>
Nov 03 14:21:48 user nova-compute[74582]:   </devices>
Nov 03 14:21:48 user nova-compute[74582]: </domain>
Nov 03 14:21:48 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2009884579',display_name='tempest-ServerActionsTestOtherA-server-2009884579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2009884579',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-bypgxfed',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=1c523af7-444b-47ad-b421-e95fa4c3aa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1153006567-network", "vif_mac": "fa:16:3e:de:e5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG os_vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0d5e87f-efff-5ea4-a358-3aa5e24db8b5', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac4c6c74-ba, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac4c6c74-ba, col_values=(('qos', UUID('546a20b9-0702-430c-be03-dba7a3d3387f')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac4c6c74-ba, col_values=(('external_ids', {'iface-id': 'ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:e5:9c', 'vm-uuid': '1c523af7-444b-47ad-b421-e95fa4c3aa0c'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:48 user nova-compute[74582]: INFO os_vif [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba')
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:21:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] No VIF found with MAC fa:16:3e:de:e5:9c, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-1a2f9979-5fe3-4011-b12b-17214ab4a84e req-c8829c41-d118-4946-9ecb-95aa80f7b472 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1a2f9979-5fe3-4011-b12b-17214ab4a84e req-c8829c41-d118-4946-9ecb-95aa80f7b472 service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1a2f9979-5fe3-4011-b12b-17214ab4a84e req-c8829c41-d118-4946-9ecb-95aa80f7b472 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1a2f9979-5fe3-4011-b12b-17214ab4a84e req-c8829c41-d118-4946-9ecb-95aa80f7b472 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-1a2f9979-5fe3-4011-b12b-17214ab4a84e req-c8829c41-d118-4946-9ecb-95aa80f7b472 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:49 user nova-compute[74582]: WARNING nova.compute.manager [req-1a2f9979-5fe3-4011-b12b-17214ab4a84e req-c8829c41-d118-4946-9ecb-95aa80f7b472 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_finish.
Nov 03 14:21:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-5d387d48-ce60-41af-aedd-b6184b9424dc req-859eba42-04bd-46e2-ab86-0997e51bdbb6 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5d387d48-ce60-41af-aedd-b6184b9424dc req-859eba42-04bd-46e2-ab86-0997e51bdbb6 service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5d387d48-ce60-41af-aedd-b6184b9424dc req-859eba42-04bd-46e2-ab86-0997e51bdbb6 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-5d387d48-ce60-41af-aedd-b6184b9424dc req-859eba42-04bd-46e2-ab86-0997e51bdbb6 service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-5d387d48-ce60-41af-aedd-b6184b9424dc req-859eba42-04bd-46e2-ab86-0997e51bdbb6 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:21:51 user nova-compute[74582]: WARNING nova.compute.manager [req-5d387d48-ce60-41af-aedd-b6184b9424dc req-859eba42-04bd-46e2-ab86-0997e51bdbb6 service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state resize_finish.
Nov 03 14:21:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:21:51 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance running successfully.
Nov 03 14:21:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Failed to set time: agent not configured {{(pid=74582) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-87297128-beab-409b-929e-c388aa44eebe tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] finish_migration finished successfully. {{(pid=74582) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 03 14:21:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:21:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:22:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:22:27 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:29 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:22:30 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:22:30 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8269MB free_disk=25.017139434814453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Applying migration context for instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c as it has an incoming, in-progress migration de6b4458-21e1-40c7-9611-0ce010fc1d04. Migration status is finished {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 14:22:30 user nova-compute[74582]: INFO nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating resource usage from migration de6b4458-21e1-40c7-9611-0ce010fc1d04
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 65fe94af-b734-4288-9e5f-c2431953790a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance ae0264f5-79d7-4e75-82ee-bc0a22d9908f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Migration de6b4458-21e1-40c7-9611-0ce010fc1d04 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:22:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:22:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Verify base images {{(pid=74582) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Image id ec3608a5-571a-4fd5-a6b3-2c26f38d8118 yields fingerprint 409b216aeb47086201e70c49d5312ee88184929a {{(pid=74582) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74582) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Image id d1bad2f4-1913-4064-b654-ebb096d97d3b yields fingerprint 9ae3a8a2a961ee50bfba42d45da28a9848c14001 {{(pid=74582) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] image d1bad2f4-1913-4064-b654-ebb096d97d3b at (/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001): checking
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] image d1bad2f4-1913-4064-b654-ebb096d97d3b at (/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001): image is in use {{(pid=74582) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] ae0264f5-79d7-4e75-82ee-bc0a22d9908f is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 1c523af7-444b-47ad-b421-e95fa4c3aa0c_resize is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 has a disk file {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 is backed by 9ae3a8a2a961ee50bfba42d45da28a9848c14001 {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e has a disk file {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e is backed by 9ae3a8a2a961ee50bfba42d45da28a9848c14001 {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 65fe94af-b734-4288-9e5f-c2431953790a is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 9658a040-77d8-45da-bb65-930ee5466b1c is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 9658a040-77d8-45da-bb65-930ee5466b1c has a disk file {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c is backed by 9ae3a8a2a961ee50bfba42d45da28a9848c14001 {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] 1c523af7-444b-47ad-b421-e95fa4c3aa0c is a valid instance name {{(pid=74582) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9
Nov 03 14:22:39 user nova-compute[74582]: WARNING nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Active base files: /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Removable base files: /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818 /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852 /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4 /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9 /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf2b39d7f4fa69524e54cc6cd785a9206297029f
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b29a4b208fc086725c85f2e42edc41f40c446818
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11ed9668849f8eee4a71bc82f7f1eefd6ba90852
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21276b90bb5c92537dcd8912e010c4caea50213d
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/91f07e8fe1b58a0542b77d59a60391c3f241f36b
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4bb198e617922ed278599201be397e88d0debcf4
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50c8047b5838b725377e56ae533462191d12267b
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a62550edfef7c468bacef6481a709c249f287b9
Nov 03 14:22:39 user nova-compute[74582]: INFO nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c58603dfc15701701af84c529492f4f97d63d203
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Verification complete {{(pid=74582) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Verify swap images {{(pid=74582) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 03 14:22:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.imagecache [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Verify ephemeral images {{(pid=74582) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 03 14:22:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-changed-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Refreshing instance network info cache due to event network-changed-5550dfb1-406d-49f3-9d79-a780fbeb7595. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] Acquiring lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] Acquired lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Refreshing network info cache for port 5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updated VIF entry in instance network info cache for port 5550dfb1-406d-49f3-9d79-a780fbeb7595. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updating instance_info_cache with network_info: [{"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-230a08ae-9d3a-4141-965c-4fcbdcdf6ec2 req-759c9c04-7af8-42f2-854a-7de804ffb350 service nova] Releasing lock "refresh_cache-ae0264f5-79d7-4e75-82ee-bc0a22d9908f" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:22:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:47 user nova-compute[74582]: INFO nova.compute.manager [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Terminating instance
Nov 03 14:22:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf8befb8-4195-4b47-8e14-1fd21ee4d36e req-bd73298d-6526-4b98-8c3b-41d262fe51f2 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-vif-unplugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf8befb8-4195-4b47-8e14-1fd21ee4d36e req-bd73298d-6526-4b98-8c3b-41d262fe51f2 service nova] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf8befb8-4195-4b47-8e14-1fd21ee4d36e req-bd73298d-6526-4b98-8c3b-41d262fe51f2 service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cf8befb8-4195-4b47-8e14-1fd21ee4d36e req-bd73298d-6526-4b98-8c3b-41d262fe51f2 service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf8befb8-4195-4b47-8e14-1fd21ee4d36e req-bd73298d-6526-4b98-8c3b-41d262fe51f2 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] No waiting events found dispatching network-vif-unplugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:22:47 user nova-compute[74582]: DEBUG nova.compute.manager [req-cf8befb8-4195-4b47-8e14-1fd21ee4d36e req-bd73298d-6526-4b98-8c3b-41d262fe51f2 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-vif-unplugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Instance destroyed successfully.
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'resources' on Instance uuid ae0264f5-79d7-4e75-82ee-bc0a22d9908f {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1571350730',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1571350730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1571350730',id=46,image_ref='ec3608a5-571a-4fd5-a6b3-2c26f38d8118',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmwN7OCTGnPMHkdzKniSoYBlmERwBF/cNKF21JgUjZxSFLjztxzXwIXAm1fVUyf5FEWaILB09LJqPz+7K/JTrawu2RByD2leEH1M8zDCLFBpb6/srSZPSSa5wEUXAWkyw==',key_name='tempest-keypair-1986456761',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-al8ngxee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1092687553',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c726e17f780a483b8b3a220dfc34125d',uuid=ae0264f5-79d7-4e75-82ee-bc0a22d9908f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "address": "fa:16:3e:db:a6:f0", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5550dfb1-40", "ovs_interfaceid": "5550dfb1-406d-49f3-9d79-a780fbeb7595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_vif [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5550dfb1-40, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b603135e-f16e-486e-af14-b776551b6d1a) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:22:48 user nova-compute[74582]: INFO os_vif [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:a6:f0,bridge_name='br-int',has_traffic_filtering=True,id=5550dfb1-406d-49f3-9d79-a780fbeb7595,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5550dfb1-40')
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGAHoWDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:22:48 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[309bf0fe-1e5a-46c6-9f08-0f75115089cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:22:48 user nova-compute[74582]: No targets found.
Nov 03 14:22:48 user nova-compute[74582]: iSNS:
Nov 03 14:22:48 user nova-compute[74582]: No targets found.
Nov 03 14:22:48 user nova-compute[74582]: STATIC:
Nov 03 14:22:48 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168
Nov 03 14:22:48 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:22:48 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:22:48 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be
Nov 03 14:22:48 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:22:48 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:22:48 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825
Nov 03 14:22:48 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:22:48 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:22:48 user nova-compute[74582]: FIRMWARE:
Nov 03 14:22:48 user nova-compute[74582]: No targets found.
Nov 03 14:22:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:22:48 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:22:48 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0440cb2-3eea-4ff3-a710-4e2b4fe26621]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[222e98e0-e120-4b28-b7eb-0f6f397e3a01]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:22:48 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:22:48 user nova-compute[74582]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:22:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:22:48 user nova-compute[74582]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be (non-flash)
Nov 03 14:22:48 user nova-compute[74582]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:22:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f88c8e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c764362-d46b-4b13-a738-2ac982d8fcec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[70caca24-9ed9-4892-b885-d380b0a8f8da]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c971cee-5423-4738-b0f7-7fc620b2cac0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809228a-9a45-4f28-88f6-c20ca867f5d5]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e353f01',) {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[75894c99-770d-4c23-91f6-6087bcf70917]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5b8481-81a6-4d13-9e59-ba515ba760b3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37565328-079d-4370-8540-00dd525a9119]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260]
Nov 03 14:22:48 user nova-compute[74582]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be, portal: 172.16.0.220,3260] successful.
Nov 03 14:22:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8ca20a-ec4d-438b-8120-7038882fa3be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b391e768-c1f2-44c8-ac8e-c9ea811b2fd3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== disconnect_volume: return (309ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:22:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Deleting instance files /opt/stack/data/nova/instances/ae0264f5-79d7-4e75-82ee-bc0a22d9908f_del
Nov 03 14:22:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Deletion of /opt/stack/data/nova/instances/ae0264f5-79d7-4e75-82ee-bc0a22d9908f_del complete
Nov 03 14:22:48 user nova-compute[74582]: INFO nova.compute.manager [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 03 14:22:48 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:22:48 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:22:49 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:22:49 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Took 0.77 seconds to deallocate network for instance.
Nov 03 14:22:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:22:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] Acquiring lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] No waiting events found dispatching network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:22:50 user nova-compute[74582]: WARNING nova.compute.manager [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received unexpected event network-vif-plugged-5550dfb1-406d-49f3-9d79-a780fbeb7595 for instance with vm_state active and task_state deleting.
Nov 03 14:22:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-b4128ecc-71fa-4022-9242-3bf2fe1501b1 req-29d51a34-58a5-4793-996a-f06671de86e3 service nova] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Received event network-vif-deleted-5550dfb1-406d-49f3-9d79-a780fbeb7595 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:22:50 user nova-compute[74582]: INFO nova.compute.manager [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Took 1.04 seconds to detach 1 volumes for instance.
Nov 03 14:22:50 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: ae0264f5-79d7-4e75-82ee-bc0a22d9908f] Deleting volume: be8ca20a-ec4d-438b-8120-7038882fa3be {{(pid=74582) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 14:22:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:22:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:22:51 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:22:51 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:22:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:51 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Deleted allocations for instance ae0264f5-79d7-4e75-82ee-bc0a22d9908f
Nov 03 14:22:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5163bd80-77ea-4f28-9d0f-012cc63e6fa6 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "ae0264f5-79d7-4e75-82ee-bc0a22d9908f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:22:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:22:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:23:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:23:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:23:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:04 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:04 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:23:04 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 1 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:23:04 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance has had 2 of 5 cleanup attempts {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 03 14:23:04 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deletion of /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize failed
Nov 03 14:23:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:23:08 user nova-compute[74582]: INFO nova.compute.claims [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Claim successful on node user
Nov 03 14:23:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:23:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.policy [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cb25ef9de143a5a55d341a089e19de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f3f5290550c487fa7c35f987312a79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:23:08 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Creating image(s)
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:08 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk 1073741824" returned: 0 in 0.074s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Successfully created port: 3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Cannot resize image /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Ensure instance console log exists: /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Successfully updated port: 3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing instance network info cache due to event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance network_info: |[{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.neutron [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Start _get_guest_xml network_info=[{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:23:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:23:10 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2145595895',display_name='tempest-ServerRescueNegativeTestJSON-server-2145595895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2145595895',id=47,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3c1Ux1Z2wLbITfjUOU2pJe71r0I8x7RXulucj0HJaMEWWNNb1q5R43npg42OjJhO2+mQ6RVGMttSCTfIf1ZK5BKlRNx5O7glXv2TAVqD0TnBohOoBt3Hr7L7khiDNN2w==',key_name='tempest-keypair-863759506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-q5sju0s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb25ef9de143a5a55d341a089e19de',uuid=3f0c48a9-4035-40ea-916a-e5cf4c6211a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.objects.instance [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Going to confirm migration 2 {{(pid=74582) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:23:10 user nova-compute[74582]:   <uuid>3f0c48a9-4035-40ea-916a-e5cf4c6211a6</uuid>
Nov 03 14:23:10 user nova-compute[74582]:   <name>instance-0000002f</name>
Nov 03 14:23:10 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:23:10 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:23:10 user nova-compute[74582]:   <metadata>
Nov 03 14:23:10 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:23:10 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:23:10 user nova-compute[74582]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2145595895</nova:name>
Nov 03 14:23:10 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:23:10</nova:creationTime>
Nov 03 14:23:10 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:23:10 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:23:10 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:23:10 user nova-compute[74582]:       <nova:owner>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:user uuid="86cb25ef9de143a5a55d341a089e19de">tempest-ServerRescueNegativeTestJSON-1868952631-project-member</nova:user>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:project uuid="9f3f5290550c487fa7c35f987312a79b">tempest-ServerRescueNegativeTestJSON-1868952631</nova:project>
Nov 03 14:23:10 user nova-compute[74582]:       </nova:owner>
Nov 03 14:23:10 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:23:10 user nova-compute[74582]:       <nova:ports>
Nov 03 14:23:10 user nova-compute[74582]:         <nova:port uuid="3ce9a11b-6762-48b0-ab18-ba10fb6293d9">
Nov 03 14:23:10 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 14:23:10 user nova-compute[74582]:         </nova:port>
Nov 03 14:23:10 user nova-compute[74582]:       </nova:ports>
Nov 03 14:23:10 user nova-compute[74582]:     </nova:instance>
Nov 03 14:23:10 user nova-compute[74582]:   </metadata>
Nov 03 14:23:10 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:23:10 user nova-compute[74582]:     <system>
Nov 03 14:23:10 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:23:10 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:23:10 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:23:10 user nova-compute[74582]:       <entry name="serial">3f0c48a9-4035-40ea-916a-e5cf4c6211a6</entry>
Nov 03 14:23:10 user nova-compute[74582]:       <entry name="uuid">3f0c48a9-4035-40ea-916a-e5cf4c6211a6</entry>
Nov 03 14:23:10 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:23:10 user nova-compute[74582]:     </system>
Nov 03 14:23:10 user nova-compute[74582]:   </sysinfo>
Nov 03 14:23:10 user nova-compute[74582]:   <os>
Nov 03 14:23:10 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:23:10 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:23:10 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:23:10 user nova-compute[74582]:   </os>
Nov 03 14:23:10 user nova-compute[74582]:   <features>
Nov 03 14:23:10 user nova-compute[74582]:     <acpi/>
Nov 03 14:23:10 user nova-compute[74582]:     <apic/>
Nov 03 14:23:10 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:23:10 user nova-compute[74582]:   </features>
Nov 03 14:23:10 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:23:10 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:23:10 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:23:10 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:23:10 user nova-compute[74582]:   </clock>
Nov 03 14:23:10 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:23:10 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:23:10 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:23:10 user nova-compute[74582]:   </cpu>
Nov 03 14:23:10 user nova-compute[74582]:   <devices>
Nov 03 14:23:10 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:23:10 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:23:10 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk"/>
Nov 03 14:23:10 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:23:10 user nova-compute[74582]:     </disk>
Nov 03 14:23:10 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:23:10 user nova-compute[74582]:       <mac address="fa:16:3e:0e:d7:92"/>
Nov 03 14:23:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:23:10 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:23:10 user nova-compute[74582]:       <target dev="tap3ce9a11b-67"/>
Nov 03 14:23:10 user nova-compute[74582]:     </interface>
Nov 03 14:23:10 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:23:10 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/console.log" append="off"/>
Nov 03 14:23:10 user nova-compute[74582]:     </serial>
Nov 03 14:23:10 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:23:10 user nova-compute[74582]:     <video>
Nov 03 14:23:10 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:23:10 user nova-compute[74582]:     </video>
Nov 03 14:23:10 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:23:10 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:23:10 user nova-compute[74582]:     </rng>
Nov 03 14:23:10 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:23:10 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:23:10 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:23:10 user nova-compute[74582]:     </memballoon>
Nov 03 14:23:10 user nova-compute[74582]:   </devices>
Nov 03 14:23:10 user nova-compute[74582]: </domain>
Nov 03 14:23:10 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2145595895',display_name='tempest-ServerRescueNegativeTestJSON-server-2145595895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2145595895',id=47,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3c1Ux1Z2wLbITfjUOU2pJe71r0I8x7RXulucj0HJaMEWWNNb1q5R43npg42OjJhO2+mQ6RVGMttSCTfIf1ZK5BKlRNx5O7glXv2TAVqD0TnBohOoBt3Hr7L7khiDNN2w==',key_name='tempest-keypair-863759506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-q5sju0s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb25ef9de143a5a55d341a089e19de',uuid=3f0c48a9-4035-40ea-916a-e5cf4c6211a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG os_vif [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a21d6c84-901f-5df0-98cb-9c99104f6ec6', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce9a11b-67, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce9a11b-67, col_values=(('qos', UUID('61c5fc90-44bc-4735-aeba-85a59d127d7b')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce9a11b-67, col_values=(('external_ids', {'iface-id': '3ce9a11b-6762-48b0-ab18-ba10fb6293d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:d7:92', 'vm-uuid': '3f0c48a9-4035-40ea-916a-e5cf4c6211a6'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:10 user nova-compute[74582]: INFO os_vif [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67')
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:0e:d7:92, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.network.neutron [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:23:10 user nova-compute[74582]: DEBUG nova.objects.instance [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'info_cache' on Instance uuid 1c523af7-444b-47ad-b421-e95fa4c3aa0c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updated VIF entry in instance network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-d7b6b83e-9814-4858-85e2-240c8351f37b req-3116c257-743c-4491-a34e-edc7ed08bd51 service nova] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.network.neutron [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.objects.instance [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'migration_context' on Instance uuid 1c523af7-444b-47ad-b421-e95fa4c3aa0c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.objects.base [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Object Instance<1c523af7-444b-47ad-b421-e95fa4c3aa0c> lazy-loaded attributes: info_cache,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.299s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:11 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Deleted allocation for migration de6b4458-21e1-40c7-9611-0ce010fc1d04
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-591a67d9-8637-4f46-8d24-748bdd90f0bb tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.239s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-4951f28a-2403-4cdb-858b-08ddc03bf43a req-cb4282d0-6a63-4267-8d9d-d9a755ad42ab service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4951f28a-2403-4cdb-858b-08ddc03bf43a req-cb4282d0-6a63-4267-8d9d-d9a755ad42ab service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4951f28a-2403-4cdb-858b-08ddc03bf43a req-cb4282d0-6a63-4267-8d9d-d9a755ad42ab service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4951f28a-2403-4cdb-858b-08ddc03bf43a req-cb4282d0-6a63-4267-8d9d-d9a755ad42ab service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-4951f28a-2403-4cdb-858b-08ddc03bf43a req-cb4282d0-6a63-4267-8d9d-d9a755ad42ab service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:23:11 user nova-compute[74582]: WARNING nova.compute.manager [req-4951f28a-2403-4cdb-858b-08ddc03bf43a req-cb4282d0-6a63-4267-8d9d-d9a755ad42ab service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state building and task_state spawning.
Nov 03 14:23:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:12 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:23:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance spawned successfully.
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:23:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:23:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-e1110dc9-613c-4f7b-b0ee-22af95db397c req-c474b3a5-293c-4456-a3be-b53082999384 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:23:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e1110dc9-613c-4f7b-b0ee-22af95db397c req-c474b3a5-293c-4456-a3be-b53082999384 service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e1110dc9-613c-4f7b-b0ee-22af95db397c req-c474b3a5-293c-4456-a3be-b53082999384 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e1110dc9-613c-4f7b-b0ee-22af95db397c req-c474b3a5-293c-4456-a3be-b53082999384 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:14 user nova-compute[74582]: DEBUG nova.compute.manager [req-e1110dc9-613c-4f7b-b0ee-22af95db397c req-c474b3a5-293c-4456-a3be-b53082999384 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:23:14 user nova-compute[74582]: WARNING nova.compute.manager [req-e1110dc9-613c-4f7b-b0ee-22af95db397c req-c474b3a5-293c-4456-a3be-b53082999384 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state building and task_state spawning.
Nov 03 14:23:14 user nova-compute[74582]: INFO nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 03 14:23:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:23:14 user nova-compute[74582]: INFO nova.compute.manager [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Took 5.98 seconds to build instance.
Nov 03 14:23:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-2f553724-08c7-4602-a39a-8e552425b13c tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.082s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:15 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:23:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:23:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:23:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:23:29 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:23:29 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating instance_info_cache with network_info: [{"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-65fe94af-b734-4288-9e5f-c2431953790a" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:23:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:23:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8284MB free_disk=24.98098373413086GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 65fe94af-b734-4288-9e5f-c2431953790a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:23:32 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:23:33 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:23:33 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:23:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:23:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "65fe94af-b734-4288-9e5f-c2431953790a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:48 user nova-compute[74582]: INFO nova.compute.manager [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Terminating instance
Nov 03 14:23:48 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-da484179-9b59-46d0-b37d-b8d9b45e8281 req-3ea615d6-d980-40a9-a1e9-9286ce568ad9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-vif-unplugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-da484179-9b59-46d0-b37d-b8d9b45e8281 req-3ea615d6-d980-40a9-a1e9-9286ce568ad9 service nova] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-da484179-9b59-46d0-b37d-b8d9b45e8281 req-3ea615d6-d980-40a9-a1e9-9286ce568ad9 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-da484179-9b59-46d0-b37d-b8d9b45e8281 req-3ea615d6-d980-40a9-a1e9-9286ce568ad9 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-da484179-9b59-46d0-b37d-b8d9b45e8281 req-3ea615d6-d980-40a9-a1e9-9286ce568ad9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] No waiting events found dispatching network-vif-unplugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:23:48 user nova-compute[74582]: DEBUG nova.compute.manager [req-da484179-9b59-46d0-b37d-b8d9b45e8281 req-3ea615d6-d980-40a9-a1e9-9286ce568ad9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-vif-unplugged-002a12b5-0892-47a8-83c6-05faeef47437 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:23:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Instance destroyed successfully.
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.objects.instance [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'resources' on Instance uuid 65fe94af-b734-4288-9e5f-c2431953790a {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2060541675',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2060541675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2060541675',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+3A+6TyWC8ZDGjaoV2iK1w2MaLuS83cbOpZ8oo3wjbXvXL8FFYgRvnxyEpwbpLS6JQuuo5LUkCIRCItgDPVlhGB6J5lSVbKl0uzWCfxe5kK/l99j83hk2zPudaSQfnPw==',key_name='tempest-keypair-1052088659',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-azdb12qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c726e17f780a483b8b3a220dfc34125d',uuid=65fe94af-b734-4288-9e5f-c2431953790a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "002a12b5-0892-47a8-83c6-05faeef47437", "address": "fa:16:3e:08:5b:25", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap002a12b5-08", "ovs_interfaceid": "002a12b5-0892-47a8-83c6-05faeef47437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_vif [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap002a12b5-08, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5c5b462-89b6-4346-993f-b5f7f09c7487) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:49 user nova-compute[74582]: INFO os_vif [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:5b:25,bridge_name='br-int',has_traffic_filtering=True,id=002a12b5-0892-47a8-83c6-05faeef47437,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002a12b5-08')
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zduHnxXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:23:49 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ed5f0-b964-4d5d-8e78-60a67a468a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:23:49 user nova-compute[74582]: No targets found.
Nov 03 14:23:49 user nova-compute[74582]: iSNS:
Nov 03 14:23:49 user nova-compute[74582]: No targets found.
Nov 03 14:23:49 user nova-compute[74582]: STATIC:
Nov 03 14:23:49 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168
Nov 03 14:23:49 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:23:49 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:23:49 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825
Nov 03 14:23:49 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:23:49 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:23:49 user nova-compute[74582]: FIRMWARE:
Nov 03 14:23:49 user nova-compute[74582]: No targets found.
Nov 03 14:23:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:23:49 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:23:49 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ca1da-2d9b-4627-bd22-ff04cbe54d99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e62c51-e884-4e43-9eba-5f6292ed7136]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:23:49 user nova-compute[74582]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:23:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 (non-flash)
Nov 03 14:23:49 user nova-compute[74582]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:23:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f683c3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9df3008-28c4-4570-810a-4d8dd0a80411]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaa9882-8dce-4967-9768-2c2929c110e6]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54ecee-b570-4ad6-8aa5-8e3863610321]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[524d4d40-55b5-4738-8c88-fd2db594052a]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e33b0d-5987-490e-9b8b-c4e9d0cecdac]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e9b43a-7c65-4a03-af02-3deb64e2008b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260]
Nov 03 14:23:49 user nova-compute[74582]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168, portal: 172.16.0.220,3260] successful.
Nov 03 14:23:49 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b38c133-dd25-43ec-9a5f-7c6b57189168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ef7bb-0e76-46d4-aa93-e8ff778e6207]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== disconnect_volume: return (316ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:23:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Deleting instance files /opt/stack/data/nova/instances/65fe94af-b734-4288-9e5f-c2431953790a_del
Nov 03 14:23:49 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Deletion of /opt/stack/data/nova/instances/65fe94af-b734-4288-9e5f-c2431953790a_del complete
Nov 03 14:23:49 user nova-compute[74582]: INFO nova.compute.manager [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 03 14:23:49 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:23:49 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:23:50 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Took 0.66 seconds to deallocate network for instance.
Nov 03 14:23:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-9cc7b7d8-0e6d-409d-8c21-8cbe5e4b85d3 req-971cf1e6-f5b3-4e2c-8e32-10526ef18d79 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-vif-deleted-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:23:50 user nova-compute[74582]: INFO nova.compute.manager [req-9cc7b7d8-0e6d-409d-8c21-8cbe5e4b85d3 req-971cf1e6-f5b3-4e2c-8e32-10526ef18d79 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Neutron deleted interface 002a12b5-0892-47a8-83c6-05faeef47437; detaching it from the instance and deleting it from the info cache
Nov 03 14:23:50 user nova-compute[74582]: DEBUG nova.network.neutron [req-9cc7b7d8-0e6d-409d-8c21-8cbe5e4b85d3 req-971cf1e6-f5b3-4e2c-8e32-10526ef18d79 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-9cc7b7d8-0e6d-409d-8c21-8cbe5e4b85d3 req-971cf1e6-f5b3-4e2c-8e32-10526ef18d79 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Detach interface failed, port_id=002a12b5-0892-47a8-83c6-05faeef47437, reason: Instance 65fe94af-b734-4288-9e5f-c2431953790a could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-2e52bc16-4ac8-46e5-b0d0-7cfebcf62284 req-3ed5ab0a-0685-4331-92eb-e32b282ec2d9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received event network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e52bc16-4ac8-46e5-b0d0-7cfebcf62284 req-3ed5ab0a-0685-4331-92eb-e32b282ec2d9 service nova] Acquiring lock "65fe94af-b734-4288-9e5f-c2431953790a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e52bc16-4ac8-46e5-b0d0-7cfebcf62284 req-3ed5ab0a-0685-4331-92eb-e32b282ec2d9 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-2e52bc16-4ac8-46e5-b0d0-7cfebcf62284 req-3ed5ab0a-0685-4331-92eb-e32b282ec2d9 service nova] Lock "65fe94af-b734-4288-9e5f-c2431953790a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:50 user nova-compute[74582]: DEBUG nova.compute.manager [req-2e52bc16-4ac8-46e5-b0d0-7cfebcf62284 req-3ed5ab0a-0685-4331-92eb-e32b282ec2d9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] No waiting events found dispatching network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:23:50 user nova-compute[74582]: WARNING nova.compute.manager [req-2e52bc16-4ac8-46e5-b0d0-7cfebcf62284 req-3ed5ab0a-0685-4331-92eb-e32b282ec2d9 service nova] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Received unexpected event network-vif-plugged-002a12b5-0892-47a8-83c6-05faeef47437 for instance with vm_state active and task_state deleting.
Nov 03 14:23:51 user nova-compute[74582]: INFO nova.compute.manager [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Took 0.87 seconds to detach 1 volumes for instance.
Nov 03 14:23:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 65fe94af-b734-4288-9e5f-c2431953790a] Deleting volume: 6b38c133-dd25-43ec-9a5f-7c6b57189168 {{(pid=74582) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 14:23:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:23:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:23:51 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:23:51 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:23:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:51 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Deleted allocations for instance 65fe94af-b734-4288-9e5f-c2431953790a
Nov 03 14:23:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-5edf580f-71f8-447c-8f54-d9f583cf43f4 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "65fe94af-b734-4288-9e5f-c2431953790a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.258s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:23:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:23:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:23:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:23:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:23:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:23:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 1c523af7-444b-47ad-b421-e95fa4c3aa0c {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "9658a040-77d8-45da-bb65-930ee5466b1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "9658a040-77d8-45da-bb65-930ee5466b1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:11 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:24:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:17 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:24:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:24:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:24:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:24:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:24:32 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8555MB free_disk=24.978309631347656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:24:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:24:33 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:24:33 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:24:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:24:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [{"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-1c523af7-444b-47ad-b421-e95fa4c3aa0c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:24:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:24:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:24:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:24:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:24:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:24:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:24:59 user nova-compute[74582]: INFO nova.compute.claims [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Claim successful on node user
Nov 03 14:24:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.network.neutron [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.policy [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c726e17f780a483b8b3a220dfc34125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333545c5c61843ac89215bcc49b520e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:24:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:24:59 user nova-compute[74582]: INFO nova.virt.block_device [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Booting with volume f67f1712-cfb0-4ed5-8af6-d6bdece05f7b at /dev/vda
Nov 03 14:24:59 user nova-compute[74582]: DEBUG os_brick.utils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6c46a5-6ddb-4be4-9e15-5fe3b93f9aea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[117a9c0f-4082-40df-9717-1d0626446414]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbc082-11cf-4790-8c22-1ffc58e63cd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de733037-89fe-4839-b53c-3ddbb2dafde1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing instance network info cache due to event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:24:59 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:24:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da6937-9994-4849-98c0-2e8b2b4c10e7]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG os_brick.utils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:24:59 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updating existing volume attachment record: 48287e7d-65ab-4389-8d05-6b629985496c {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'flavor' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG nova.network.neutron [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Successfully created port: bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:00 user nova-compute[74582]: INFO nova.compute.manager [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Attaching volume d5229e4d-234d-4619-bbdb-740281ff0359 to /dev/vdb
Nov 03 14:25:00 user nova-compute[74582]: DEBUG os_brick.utils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f892368b-4742-439c-b521-b380eb77ab78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06312aae-8329-4eea-aeed-a9c3a38e9cb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ee5e2-d6ff-41ec-90cb-8bb57181de70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c4cfd-639f-46df-bdfd-f7f66eaa83a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updated VIF entry in instance network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG nova.network.neutron [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f2320dc-a22c-4c16-b437-5671119a67de req-2653e03c-ec11-459b-afca-0d58da1892ff service nova] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:25:00 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:25:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad3dd2-317d-4c05-9aec-95157b1e6de4]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG os_brick.utils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:25:00 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating existing volume attachment record: 8d3f51a5-9184-4561-9fe1-2a415c21b894 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Successfully updated port: bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquired lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-changed-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Refreshing instance network info cache due to event network-changed-bcb85dd3-80e5-4dd4-876b-672c1529fbf0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] Acquiring lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.network.neutron [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updating instance_info_cache with network_info: [{"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Releasing lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Instance network_info: |[{"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] Acquired lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:25:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Refreshing network info cache for port bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:25:01 user nova-compute[74582]: INFO nova.compute.manager [None req-202d6ce6-9016-4c03-858f-20770a9be862 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Get console output
Nov 03 14:25:01 user nova-compute[74582]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 03 14:25:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updated VIF entry in instance network info cache for port bcb85dd3-80e5-4dd4-876b-672c1529fbf0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:25:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updating instance_info_cache with network_info: [{"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:25:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4136b297-c68b-4c1c-b5d2-cd2174fced14 req-8205f225-0a93-44ae-be72-3497282b5073 service nova] Releasing lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:25:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:13 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:25:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:18 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:25:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Creating image(s)
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Ensure instance console log exists: /opt/stack/data/nova/instances/6bbf8612-781c-43c3-9322-ceb1805ff0c5/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Start _get_guest_xml network_info=[{"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '48287e7d-65ab-4389-8d05-6b629985496c', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bbf8612-781c-43c3-9322-ceb1805ff0c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'serial': 'f67f1712-cfb0-4ed5-8af6-d6bdece05f7b'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:25:19 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:25:19 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:25:19 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:25:19 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:25:19 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c5a7b8-f7dd-4def-af3d-86f85ca6140a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:25:19 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b7c18-8802-4f20-8659-eaef68535916]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b] added
Nov 03 14:25:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[295f8b7b-54fc-44be-8a42-93f6431ee91b]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f428c4bb-ec26-4b91-9e23-e10e1eebf11a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVMNRgaO {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVMNRgaO" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c73f10-27a1-4d9d-8458-4f6ddc9a929e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVMNRgaO'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc562f-d0c4-4446-8adc-38c0f29db93e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe553478-d23b-4353-ae85-d863f8ad722f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf0a37-c4b6-48b2-9e3f-52103b65c9be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]
Nov 03 14:25:19 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.
Nov 03 14:25:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a403af-ac86-43d9-9237-9575c41a0d84]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61a8860-d732-4558-bfac-ffe7aa69712f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:19 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:25:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:19 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:25:19 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51b9b6-4930-4fad-82cb-aadc7cb6d38f]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBKeuONx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:25:19 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:25:19 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23965316334313437', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965316334313437', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.858s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:25:20 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:25:20 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27ea22-b179-4d39-9dd5-3bf5cfe01d75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:25:20 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086742079',display_name='tempest-TestVolumeBootPattern-server-1086742079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086742079',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-rv0fl3ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:25:00Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=6bbf8612-781c-43c3-9322-ceb1805ff0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.objects.instance [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bbf8612-781c-43c3-9322-ceb1805ff0c5 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:25:20 user nova-compute[74582]:   <uuid>6bbf8612-781c-43c3-9322-ceb1805ff0c5</uuid>
Nov 03 14:25:20 user nova-compute[74582]:   <name>instance-00000030</name>
Nov 03 14:25:20 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:25:20 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:25:20 user nova-compute[74582]:   <metadata>
Nov 03 14:25:20 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:25:20 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:25:20 user nova-compute[74582]:       <nova:name>tempest-TestVolumeBootPattern-server-1086742079</nova:name>
Nov 03 14:25:20 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:25:19</nova:creationTime>
Nov 03 14:25:20 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:25:20 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:25:20 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:25:20 user nova-compute[74582]:       <nova:owner>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:user uuid="c726e17f780a483b8b3a220dfc34125d">tempest-TestVolumeBootPattern-1092687553-project-member</nova:user>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:project uuid="333545c5c61843ac89215bcc49b520e3">tempest-TestVolumeBootPattern-1092687553</nova:project>
Nov 03 14:25:20 user nova-compute[74582]:       </nova:owner>
Nov 03 14:25:20 user nova-compute[74582]:       <nova:ports>
Nov 03 14:25:20 user nova-compute[74582]:         <nova:port uuid="bcb85dd3-80e5-4dd4-876b-672c1529fbf0">
Nov 03 14:25:20 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 14:25:20 user nova-compute[74582]:         </nova:port>
Nov 03 14:25:20 user nova-compute[74582]:       </nova:ports>
Nov 03 14:25:20 user nova-compute[74582]:     </nova:instance>
Nov 03 14:25:20 user nova-compute[74582]:   </metadata>
Nov 03 14:25:20 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:25:20 user nova-compute[74582]:     <system>
Nov 03 14:25:20 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:25:20 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:25:20 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:25:20 user nova-compute[74582]:       <entry name="serial">6bbf8612-781c-43c3-9322-ceb1805ff0c5</entry>
Nov 03 14:25:20 user nova-compute[74582]:       <entry name="uuid">6bbf8612-781c-43c3-9322-ceb1805ff0c5</entry>
Nov 03 14:25:20 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:25:20 user nova-compute[74582]:     </system>
Nov 03 14:25:20 user nova-compute[74582]:   </sysinfo>
Nov 03 14:25:20 user nova-compute[74582]:   <os>
Nov 03 14:25:20 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:25:20 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:25:20 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:25:20 user nova-compute[74582]:   </os>
Nov 03 14:25:20 user nova-compute[74582]:   <features>
Nov 03 14:25:20 user nova-compute[74582]:     <acpi/>
Nov 03 14:25:20 user nova-compute[74582]:     <apic/>
Nov 03 14:25:20 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:25:20 user nova-compute[74582]:   </features>
Nov 03 14:25:20 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:25:20 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:25:20 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:25:20 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:25:20 user nova-compute[74582]:   </clock>
Nov 03 14:25:20 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:25:20 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:25:20 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:25:20 user nova-compute[74582]:   </cpu>
Nov 03 14:25:20 user nova-compute[74582]:   <devices>
Nov 03 14:25:20 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:25:20 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:25:20 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 14:25:20 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:25:20 user nova-compute[74582]:       <serial>f67f1712-cfb0-4ed5-8af6-d6bdece05f7b</serial>
Nov 03 14:25:20 user nova-compute[74582]:     </disk>
Nov 03 14:25:20 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:25:20 user nova-compute[74582]:       <mac address="fa:16:3e:a3:bd:b2"/>
Nov 03 14:25:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:25:20 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:25:20 user nova-compute[74582]:       <target dev="tapbcb85dd3-80"/>
Nov 03 14:25:20 user nova-compute[74582]:     </interface>
Nov 03 14:25:20 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:25:20 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/6bbf8612-781c-43c3-9322-ceb1805ff0c5/console.log" append="off"/>
Nov 03 14:25:20 user nova-compute[74582]:     </serial>
Nov 03 14:25:20 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:25:20 user nova-compute[74582]:     <video>
Nov 03 14:25:20 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:25:20 user nova-compute[74582]:     </video>
Nov 03 14:25:20 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:25:20 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:25:20 user nova-compute[74582]:     </rng>
Nov 03 14:25:20 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:25:20 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:25:20 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:25:20 user nova-compute[74582]:     </memballoon>
Nov 03 14:25:20 user nova-compute[74582]:   </devices>
Nov 03 14:25:20 user nova-compute[74582]: </domain>
Nov 03 14:25:20 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086742079',display_name='tempest-TestVolumeBootPattern-server-1086742079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086742079',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-rv0fl3ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:25:00Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=6bbf8612-781c-43c3-9322-ceb1805ff0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_vif [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b680320-3c7e-4923-98b6-23cb2a0f0dd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359] added
Nov 03 14:25:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '542ceaed-d09a-590f-98e0-0b5dc19e6a06', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcb85dd3-80, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcb85dd3-80, col_values=(('qos', UUID('010b4ca0-078a-44d2-9f18-de9391f6d790')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcb85dd3-80, col_values=(('external_ids', {'iface-id': 'bcb85dd3-80e5-4dd4-876b-672c1529fbf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:bd:b2', 'vm-uuid': '6bbf8612-781c-43c3-9322-ceb1805ff0c5'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[714fed2a-8fb1-437f-a991-4ceab14161b8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:20 user nova-compute[74582]: INFO os_vif [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80')
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f5372-69c9-452b-877a-5f46a58194c0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBKeuONx {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBKeuONx" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaf90a0-90ad-4f7f-a8b4-969a28bf5f50]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MBKeuONx'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No VIF found with MAC fa:16:3e:a3:bd:b2, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe4a7ba-0e22-49ba-b414-9f5db5d934aa]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2265856a-4312-4951-8c96-44f15ba94a1c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:20 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:25:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:20 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:25:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5211b1-b166-4f4f-b03c-c31e617e84f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260]
Nov 03 14:25:20 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260] successful.
Nov 03 14:25:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb269c4-4821-4449-9bfe-748e3c2d353e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f05d3-762c-4bbf-a470-4cd55a51abbd]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:20 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:25:20 user nova-compute[74582]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:25:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:25:20 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:25:20 user nova-compute[74582]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:25:20 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1e3ab-90f6-464a-9a25-b9a5803cf896]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:25:20 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBKeuONx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] <== connect_volume: return (2178ms) {'type': 'block', 'scsi_wwn': '23632626136666164', 'path': '/dev/sdd'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632626136666164', 'path': '/dev/sdd'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG nova.objects.instance [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'flavor' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:21 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:25:21 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:25:21 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:25:21 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:25:21 user nova-compute[74582]:   <serial>d5229e4d-234d-4619-bbdb-740281ff0359</serial>
Nov 03 14:25:21 user nova-compute[74582]: </disk>
Nov 03 14:25:21 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-246ede1e-746e-483e-a5ef-4044e3028f32 req-7a235179-5d70-42ea-81c4-7a0c6db02fb2 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-246ede1e-746e-483e-a5ef-4044e3028f32 req-7a235179-5d70-42ea-81c4-7a0c6db02fb2 service nova] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-246ede1e-746e-483e-a5ef-4044e3028f32 req-7a235179-5d70-42ea-81c4-7a0c6db02fb2 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-246ede1e-746e-483e-a5ef-4044e3028f32 req-7a235179-5d70-42ea-81c4-7a0c6db02fb2 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG nova.compute.manager [req-246ede1e-746e-483e-a5ef-4044e3028f32 req-7a235179-5d70-42ea-81c4-7a0c6db02fb2 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] No waiting events found dispatching network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:25:22 user nova-compute[74582]: WARNING nova.compute.manager [req-246ede1e-746e-483e-a5ef-4044e3028f32 req-7a235179-5d70-42ea-81c4-7a0c6db02fb2 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received unexpected event network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 for instance with vm_state building and task_state spawning.
Nov 03 14:25:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:0e:d7:92, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:25:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-3841bf65-950e-4ee7-af37-faf71b24da40 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.599s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:24 user nova-compute[74582]: INFO nova.compute.manager [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Rescuing
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-52db51cd-8658-49e6-813a-86e59690d391 req-cea93560-7f9e-4218-b190-05fdfafc4761 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-52db51cd-8658-49e6-813a-86e59690d391 req-cea93560-7f9e-4218-b190-05fdfafc4761 service nova] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-52db51cd-8658-49e6-813a-86e59690d391 req-cea93560-7f9e-4218-b190-05fdfafc4761 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-52db51cd-8658-49e6-813a-86e59690d391 req-cea93560-7f9e-4218-b190-05fdfafc4761 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-52db51cd-8658-49e6-813a-86e59690d391 req-cea93560-7f9e-4218-b190-05fdfafc4761 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] No waiting events found dispatching network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:25:24 user nova-compute[74582]: WARNING nova.compute.manager [req-52db51cd-8658-49e6-813a-86e59690d391 req-cea93560-7f9e-4218-b190-05fdfafc4761 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received unexpected event network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 for instance with vm_state building and task_state spawning.
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:25:24 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Instance spawned successfully.
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:25:24 user nova-compute[74582]: INFO nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:24 user nova-compute[74582]: INFO nova.compute.manager [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Took 25.50 seconds to build instance.
Nov 03 14:25:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-21d82451-6a0c-4fcc-869b-78fd30e02289 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.622s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-8d5339dc-23ac-4ca5-ade1-f5a219e5aad2 req-41eee480-795e-41a2-a282-88ecc2d860c5 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8d5339dc-23ac-4ca5-ade1-f5a219e5aad2 req-41eee480-795e-41a2-a282-88ecc2d860c5 service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8d5339dc-23ac-4ca5-ade1-f5a219e5aad2 req-41eee480-795e-41a2-a282-88ecc2d860c5 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-8d5339dc-23ac-4ca5-ade1-f5a219e5aad2 req-41eee480-795e-41a2-a282-88ecc2d860c5 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-8d5339dc-23ac-4ca5-ade1-f5a219e5aad2 req-41eee480-795e-41a2-a282-88ecc2d860c5 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:25:24 user nova-compute[74582]: WARNING nova.compute.manager [req-8d5339dc-23ac-4ca5-ade1-f5a219e5aad2 req-41eee480-795e-41a2-a282-88ecc2d860c5 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state active and task_state rescuing.
Nov 03 14:25:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance destroyed successfully.
Nov 03 14:25:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Attempting rescue
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74582) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance directory exists: not creating {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 14:25:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Creating image(s)
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue" returned: 0 in 0.053s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'migration_context' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.base [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<3f0c48a9-4035-40ea-916a-e5cf4c6211a6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Start _get_guest_xml network_info=[{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:0e:d7:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'resources' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.base [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<3f0c48a9-4035-40ea-916a-e5cf4c6211a6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.base [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<3f0c48a9-4035-40ea-916a-e5cf4c6211a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:25:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:25:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.base [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<3f0c48a9-4035-40ea-916a-e5cf4c6211a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2145595895',display_name='tempest-ServerRescueNegativeTestJSON-server-2145595895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2145595895',id=47,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3c1Ux1Z2wLbITfjUOU2pJe71r0I8x7RXulucj0HJaMEWWNNb1q5R43npg42OjJhO2+mQ6RVGMttSCTfIf1ZK5BKlRNx5O7glXv2TAVqD0TnBohOoBt3Hr7L7khiDNN2w==',key_name='tempest-keypair-863759506',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-q5sju0s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb25ef9de143a5a55d341a089e19de',uuid=3f0c48a9-4035-40ea-916a-e5cf4c6211a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:0e:d7:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "vif_mac": "fa:16:3e:0e:d7:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.objects.base [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Object Instance<3f0c48a9-4035-40ea-916a-e5cf4c6211a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74582) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:25:25 user nova-compute[74582]:   <uuid>3f0c48a9-4035-40ea-916a-e5cf4c6211a6</uuid>
Nov 03 14:25:25 user nova-compute[74582]:   <name>instance-0000002f</name>
Nov 03 14:25:25 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:25:25 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:25:25 user nova-compute[74582]:   <metadata>
Nov 03 14:25:25 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:25:25 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:25:25 user nova-compute[74582]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2145595895</nova:name>
Nov 03 14:25:25 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:25:25</nova:creationTime>
Nov 03 14:25:25 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:25:25 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:25:25 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:25:25 user nova-compute[74582]:       <nova:owner>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:user uuid="86cb25ef9de143a5a55d341a089e19de">tempest-ServerRescueNegativeTestJSON-1868952631-project-member</nova:user>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:project uuid="9f3f5290550c487fa7c35f987312a79b">tempest-ServerRescueNegativeTestJSON-1868952631</nova:project>
Nov 03 14:25:25 user nova-compute[74582]:       </nova:owner>
Nov 03 14:25:25 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:25:25 user nova-compute[74582]:       <nova:ports>
Nov 03 14:25:25 user nova-compute[74582]:         <nova:port uuid="3ce9a11b-6762-48b0-ab18-ba10fb6293d9">
Nov 03 14:25:25 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 14:25:25 user nova-compute[74582]:         </nova:port>
Nov 03 14:25:25 user nova-compute[74582]:       </nova:ports>
Nov 03 14:25:25 user nova-compute[74582]:     </nova:instance>
Nov 03 14:25:25 user nova-compute[74582]:   </metadata>
Nov 03 14:25:25 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:25:25 user nova-compute[74582]:     <system>
Nov 03 14:25:25 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:25:25 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:25:25 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:25:25 user nova-compute[74582]:       <entry name="serial">3f0c48a9-4035-40ea-916a-e5cf4c6211a6</entry>
Nov 03 14:25:25 user nova-compute[74582]:       <entry name="uuid">3f0c48a9-4035-40ea-916a-e5cf4c6211a6</entry>
Nov 03 14:25:25 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:25:25 user nova-compute[74582]:     </system>
Nov 03 14:25:25 user nova-compute[74582]:   </sysinfo>
Nov 03 14:25:25 user nova-compute[74582]:   <os>
Nov 03 14:25:25 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:25:25 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:25:25 user nova-compute[74582]:   </os>
Nov 03 14:25:25 user nova-compute[74582]:   <features>
Nov 03 14:25:25 user nova-compute[74582]:     <acpi/>
Nov 03 14:25:25 user nova-compute[74582]:     <apic/>
Nov 03 14:25:25 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:25:25 user nova-compute[74582]:   </features>
Nov 03 14:25:25 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:25:25 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:25:25 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:25:25 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:25:25 user nova-compute[74582]:   </clock>
Nov 03 14:25:25 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:25:25 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:25:25 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:25:25 user nova-compute[74582]:   </cpu>
Nov 03 14:25:25 user nova-compute[74582]:   <devices>
Nov 03 14:25:25 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:25:25 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:25:25 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue"/>
Nov 03 14:25:25 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:25:25 user nova-compute[74582]:     </disk>
Nov 03 14:25:25 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:25:25 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:25:25 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk"/>
Nov 03 14:25:25 user nova-compute[74582]:       <target dev="vdb" bus="virtio"/>
Nov 03 14:25:25 user nova-compute[74582]:     </disk>
Nov 03 14:25:25 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:25:25 user nova-compute[74582]:       <mac address="fa:16:3e:0e:d7:92"/>
Nov 03 14:25:25 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:25:25 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:25:25 user nova-compute[74582]:       <target dev="tap3ce9a11b-67"/>
Nov 03 14:25:25 user nova-compute[74582]:     </interface>
Nov 03 14:25:25 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:25:25 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/console.log" append="off"/>
Nov 03 14:25:25 user nova-compute[74582]:     </serial>
Nov 03 14:25:25 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:25:25 user nova-compute[74582]:     <video>
Nov 03 14:25:25 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:25:25 user nova-compute[74582]:     </video>
Nov 03 14:25:25 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:25:25 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:25:25 user nova-compute[74582]:     </rng>
Nov 03 14:25:25 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:25:25 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:25:25 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:25:25 user nova-compute[74582]:     </memballoon>
Nov 03 14:25:25 user nova-compute[74582]:   </devices>
Nov 03 14:25:25 user nova-compute[74582]: </domain>
Nov 03 14:25:25 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:25:25 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance destroyed successfully.
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:25:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] No VIF found with MAC fa:16:3e:0e:d7:92, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:25:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-658a3d17-6193-4f90-9c7d-b72eddb1c342 req-c75f45df-504b-4ed0-bd36-4fa11ded5ecb service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-658a3d17-6193-4f90-9c7d-b72eddb1c342 req-c75f45df-504b-4ed0-bd36-4fa11ded5ecb service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-658a3d17-6193-4f90-9c7d-b72eddb1c342 req-c75f45df-504b-4ed0-bd36-4fa11ded5ecb service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-658a3d17-6193-4f90-9c7d-b72eddb1c342 req-c75f45df-504b-4ed0-bd36-4fa11ded5ecb service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-658a3d17-6193-4f90-9c7d-b72eddb1c342 req-c75f45df-504b-4ed0-bd36-4fa11ded5ecb service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:25:26 user nova-compute[74582]: WARNING nova.compute.manager [req-658a3d17-6193-4f90-9c7d-b72eddb1c342 req-c75f45df-504b-4ed0-bd36-4fa11ded5ecb service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state active and task_state rescuing.
Nov 03 14:25:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:25:28 user nova-compute[74582]: WARNING nova.compute.manager [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state active and task_state rescuing.
Nov 03 14:25:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:25:28 user nova-compute[74582]: WARNING nova.compute.manager [req-28d13c1e-4258-4229-9da9-c461cace6ef4 req-bd003613-322f-41ec-8cb7-a25d4752eb0f service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state active and task_state rescuing.
Nov 03 14:25:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-24821640-963f-477c-b3c8-40bd23f88191 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:25:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:30 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:31 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:25:32 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:25:33 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:25:33 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=24.974777221679688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6bbf8612-781c-43c3-9322-ceb1805ff0c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:25:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:25:34 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:25:35 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [{"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:25:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-6c2a8ccb-6b67-457c-bd6e-2c93161315e3" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:25:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:25:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:25:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:25:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:02 user nova-compute[74582]: INFO nova.compute.manager [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Terminating instance
Nov 03 14:26:02 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-13359055-a795-42d0-9428-0315cab54729 req-ec68a0db-01cb-4fd8-98e8-4555d28208cc service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13359055-a795-42d0-9428-0315cab54729 req-ec68a0db-01cb-4fd8-98e8-4555d28208cc service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13359055-a795-42d0-9428-0315cab54729 req-ec68a0db-01cb-4fd8-98e8-4555d28208cc service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-13359055-a795-42d0-9428-0315cab54729 req-ec68a0db-01cb-4fd8-98e8-4555d28208cc service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-13359055-a795-42d0-9428-0315cab54729 req-ec68a0db-01cb-4fd8-98e8-4555d28208cc service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-13359055-a795-42d0-9428-0315cab54729 req-ec68a0db-01cb-4fd8-98e8-4555d28208cc service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-unplugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Instance destroyed successfully.
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'resources' on Instance uuid 1c523af7-444b-47ad-b421-e95fa4c3aa0c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2009884579',display_name='tempest-ServerActionsTestOtherA-server-2009884579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2009884579',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:21:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-bypgxfed',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=1c523af7-444b-47ad-b421-e95fa4c3aa0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "address": "fa:16:3e:de:e5:9c", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4c6c74-ba", "ovs_interfaceid": "ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_vif [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac4c6c74-ba, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=546a20b9-0702-430c-be03-dba7a3d3387f) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:03 user nova-compute[74582]: INFO os_vif [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:e5:9c,bridge_name='br-int',has_traffic_filtering=True,id=ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4c6c74-ba')
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikbJyzYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:26:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a895e7fc-2d53-4694-8e16-bf7061dc0782]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:26:03 user nova-compute[74582]: No targets found.
Nov 03 14:26:03 user nova-compute[74582]: iSNS:
Nov 03 14:26:03 user nova-compute[74582]: No targets found.
Nov 03 14:26:03 user nova-compute[74582]: STATIC:
Nov 03 14:26:03 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359
Nov 03 14:26:03 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:26:03 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:26:03 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b
Nov 03 14:26:03 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:26:03 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:26:03 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825
Nov 03 14:26:03 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:26:03 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:26:03 user nova-compute[74582]: FIRMWARE:
Nov 03 14:26:03 user nova-compute[74582]: No targets found.
Nov 03 14:26:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:26:03 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:26:03 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a2b62-b41c-4337-98c3-0072a8e2aa10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e0870-242a-49ae-b335-a73d5423bd7b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:26:03 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:26:03 user nova-compute[74582]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:26:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 (non-flash)
Nov 03 14:26:03 user nova-compute[74582]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:26:03 user nova-compute[74582]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:26:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f803bb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[be289f74-b4c9-4f29-9996-d66a17a72160]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d32c8f-fbeb-48eb-b7df-d6c99986ea7a]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e8ac4-44de-4825-87fb-e1e554ccfc25]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624051e-f2bd-4a0a-95f1-517221520769]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOccb5ef2e-0776e7e43f4136a1', '/dev/disk/by-id/scsi-23037373665376534', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ccb5ef2e') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b7a809-c720-4e9a-9c12-6d87386ef1f6]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca283ee3-ed46-466f-bda1-fb42703b84b0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fafb89c-4728-4847-9d7d-361bbb928a13]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260]
Nov 03 14:26:03 user nova-compute[74582]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825, portal: 172.16.0.220,3260] successful.
Nov 03 14:26:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aebd8cb-f6b4-4327-a35f-edaa9087c825 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b30ccf-3113-46d6-987c-9a2a05dfd5b0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] <== disconnect_volume: return (296ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:26:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Deleting instance files /opt/stack/data/nova/instances/1c523af7-444b-47ad-b421-e95fa4c3aa0c_del
Nov 03 14:26:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Deletion of /opt/stack/data/nova/instances/1c523af7-444b-47ad-b421-e95fa4c3aa0c_del complete
Nov 03 14:26:03 user nova-compute[74582]: INFO nova.compute.manager [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 03 14:26:03 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:26:03 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:26:04 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:26:04 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Took 0.87 seconds to deallocate network for instance.
Nov 03 14:26:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-f64a58de-b8d4-43e6-8c63-9d35c7b6d78f req-c1a545f2-b133-4675-94ee-f30607c7ee2d service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-deleted-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcc282fe-a831-4137-a55a-d7b4d9124d8e req-d374f3f0-a993-410c-bc0d-db309a685d1d service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcc282fe-a831-4137-a55a-d7b4d9124d8e req-d374f3f0-a993-410c-bc0d-db309a685d1d service nova] Acquiring lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcc282fe-a831-4137-a55a-d7b4d9124d8e req-d374f3f0-a993-410c-bc0d-db309a685d1d service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcc282fe-a831-4137-a55a-d7b4d9124d8e req-d374f3f0-a993-410c-bc0d-db309a685d1d service nova] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcc282fe-a831-4137-a55a-d7b4d9124d8e req-d374f3f0-a993-410c-bc0d-db309a685d1d service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] No waiting events found dispatching network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:26:04 user nova-compute[74582]: WARNING nova.compute.manager [req-fcc282fe-a831-4137-a55a-d7b4d9124d8e req-d374f3f0-a993-410c-bc0d-db309a685d1d service nova] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Received unexpected event network-vif-plugged-ac4c6c74-ba48-4437-a6be-beaf2c7f2d1e for instance with vm_state active and task_state deleting.
Nov 03 14:26:05 user nova-compute[74582]: INFO nova.compute.manager [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Took 0.92 seconds to detach 1 volumes for instance.
Nov 03 14:26:05 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 1c523af7-444b-47ad-b421-e95fa4c3aa0c] Deleting volume: 2aebd8cb-f6b4-4327-a35f-edaa9087c825 {{(pid=74582) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 14:26:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:05 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:26:05 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:26:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:06 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Deleted allocations for instance 1c523af7-444b-47ad-b421-e95fa4c3aa0c
Nov 03 14:26:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a67aeaba-05ca-483f-aca4-41bcadce08a4 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "1c523af7-444b-47ad-b421-e95fa4c3aa0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.623s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:26:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:26:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:26:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:15 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:17 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:19 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:26:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:26:31 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:32 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:26:34 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:26:34 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=24.97354507446289GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 6bbf8612-781c-43c3-9322-ceb1805ff0c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:26:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:26:35 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:26:35 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:26:35 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:26:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-changed-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG nova.compute.manager [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Refreshing instance network info cache due to event network-changed-bcb85dd3-80e5-4dd4-876b-672c1529fbf0. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] Acquiring lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] Acquired lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG nova.network.neutron [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Refreshing network info cache for port bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG nova.network.neutron [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updated VIF entry in instance network info cache for port bcb85dd3-80e5-4dd4-876b-672c1529fbf0. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG nova.network.neutron [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updating instance_info_cache with network_info: [{"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-563fc89e-b512-4eb2-82cd-db07dc1b3d2f req-cb82b31d-8b3f-4cfb-bfad-0c1eb7ad5771 service nova] Releasing lock "refresh_cache-6bbf8612-781c-43c3-9322-ceb1805ff0c5" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:51 user nova-compute[74582]: INFO nova.compute.manager [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Terminating instance
Nov 03 14:26:51 user nova-compute[74582]: DEBUG nova.compute.manager [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Instance destroyed successfully.
Nov 03 14:26:52 user nova-compute[74582]: DEBUG nova.objects.instance [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'resources' on Instance uuid 6bbf8612-781c-43c3-9322-ceb1805ff0c5 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086742079',display_name='tempest-TestVolumeBootPattern-server-1086742079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086742079',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-rv0fl3ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:25:25Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=6bbf8612-781c-43c3-9322-ceb1805ff0c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "address": "fa:16:3e:a3:bd:b2", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb85dd3-80", "ovs_interfaceid": "bcb85dd3-80e5-4dd4-876b-672c1529fbf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_vif [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcb85dd3-80, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=010b4ca0-078a-44d2-9f18-de9391f6d790) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:26:52 user nova-compute[74582]: INFO os_vif [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:bd:b2,bridge_name='br-int',has_traffic_filtering=True,id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb85dd3-80')
Nov 03 14:26:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:26:52 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd25fbca-64fb-4d19-84a9-767cdcfcfa60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:26:52 user nova-compute[74582]: No targets found.
Nov 03 14:26:52 user nova-compute[74582]: iSNS:
Nov 03 14:26:52 user nova-compute[74582]: No targets found.
Nov 03 14:26:52 user nova-compute[74582]: STATIC:
Nov 03 14:26:52 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359
Nov 03 14:26:52 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:26:52 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:26:52 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b
Nov 03 14:26:52 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:26:52 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:26:52 user nova-compute[74582]: FIRMWARE:
Nov 03 14:26:52 user nova-compute[74582]: No targets found.
Nov 03 14:26:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:26:52 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:26:52 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8f558a-918b-40eb-b42c-a8004fabca80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2470b8ac-021f-400a-8887-7f85a676f1cc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:26:52 user nova-compute[74582]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:26:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:26:52 user nova-compute[74582]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:26:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f487da440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4101f11-16d7-4a3c-934e-2f6dca3611ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad305a1-04cd-4a1f-91bd-599260bc9fbc]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47cd92a-732f-4d65-bca6-7046308334da]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[17645509-0193-4f61-9bc2-30988061198c]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4c6ebdb5',) {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38c2df3-b95e-459a-b2d3-d19cbec095d0]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa0b061-af7b-426a-abab-379ad24ad6b6]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3274ed90-3143-4f8e-a29b-d88bb2d89398]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]
Nov 03 14:26:52 user nova-compute[74582]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.
Nov 03 14:26:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4e289e-8714-4b61-9adf-1443c12e3856]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== disconnect_volume: return (324ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:26:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:26:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Deleting instance files /opt/stack/data/nova/instances/6bbf8612-781c-43c3-9322-ceb1805ff0c5_del
Nov 03 14:26:52 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Deletion of /opt/stack/data/nova/instances/6bbf8612-781c-43c3-9322-ceb1805ff0c5_del complete
Nov 03 14:26:53 user nova-compute[74582]: INFO nova.compute.manager [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-vif-unplugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] No waiting events found dispatching network-vif-unplugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-vif-unplugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] Acquiring lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] No waiting events found dispatching network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:26:53 user nova-compute[74582]: WARNING nova.compute.manager [req-f3f90f6d-3c8d-4bea-8a0d-8f0902ac12b2 req-09b8c288-b994-464c-86ca-5734325813b7 service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received unexpected event network-vif-plugged-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 for instance with vm_state active and task_state deleting.
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3fb4395-cd45-4741-b5fb-87f5869ce851 req-8928e627-1f44-4bac-9d90-39e9d1069b1b service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Received event network-vif-deleted-bcb85dd3-80e5-4dd4-876b-672c1529fbf0 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:26:53 user nova-compute[74582]: INFO nova.compute.manager [req-f3fb4395-cd45-4741-b5fb-87f5869ce851 req-8928e627-1f44-4bac-9d90-39e9d1069b1b service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Neutron deleted interface bcb85dd3-80e5-4dd4-876b-672c1529fbf0; detaching it from the instance and deleting it from the info cache
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.network.neutron [req-f3fb4395-cd45-4741-b5fb-87f5869ce851 req-8928e627-1f44-4bac-9d90-39e9d1069b1b service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:26:53 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Took 0.67 seconds to deallocate network for instance.
Nov 03 14:26:53 user nova-compute[74582]: DEBUG nova.compute.manager [req-f3fb4395-cd45-4741-b5fb-87f5869ce851 req-8928e627-1f44-4bac-9d90-39e9d1069b1b service nova] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Detach interface failed, port_id=bcb85dd3-80e5-4dd4-876b-672c1529fbf0, reason: Instance 6bbf8612-781c-43c3-9322-ceb1805ff0c5 could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:26:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:27:03 user nova-compute[74582]: INFO nova.compute.manager [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 6bbf8612-781c-43c3-9322-ceb1805ff0c5] Took 9.82 seconds to detach 1 volumes for instance.
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:03 user nova-compute[74582]: INFO nova.compute.manager [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Terminating instance
Nov 03 14:27:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:03 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Deleted allocations for instance 6bbf8612-781c-43c3-9322-ceb1805ff0c5
Nov 03 14:27:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-700a47d9-73dd-469d-9105-d8299b36fd18 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "6bbf8612-781c-43c3-9322-ceb1805ff0c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.172s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-7874e2a1-ff9e-43c9-939a-eb2668d2749d req-b03a1045-119f-464d-a3a1-bd92f62bfaa2 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-vif-unplugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7874e2a1-ff9e-43c9-939a-eb2668d2749d req-b03a1045-119f-464d-a3a1-bd92f62bfaa2 service nova] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7874e2a1-ff9e-43c9-939a-eb2668d2749d req-b03a1045-119f-464d-a3a1-bd92f62bfaa2 service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7874e2a1-ff9e-43c9-939a-eb2668d2749d req-b03a1045-119f-464d-a3a1-bd92f62bfaa2 service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-7874e2a1-ff9e-43c9-939a-eb2668d2749d req-b03a1045-119f-464d-a3a1-bd92f62bfaa2 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] No waiting events found dispatching network-vif-unplugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.compute.manager [req-7874e2a1-ff9e-43c9-939a-eb2668d2749d req-b03a1045-119f-464d-a3a1-bd92f62bfaa2 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-vif-unplugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:27:04 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Instance destroyed successfully.
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lazy-loading 'resources' on Instance uuid 6c2a8ccb-6b67-457c-bd6e-2c93161315e3 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T13:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268045556',display_name='tempest-ServerActionsTestOtherA-server-268045556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268045556',id=15,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdeGqbXV/hDGkT0K/TmGKp50fFXp1herJkatVd0xWJxpJL1fTA6VmqWttUcDaJMbaR97U6f6+n5DSyjYHqe/zXfhEhiUcDTD821V/F6q+Wt5PF1m/TIiEl/OXtja38jaA==',key_name='tempest-keypair-1394298984',keypairs=<?>,launch_index=0,launched_at=2023-11-03T13:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89d23e2540d949c28d9db7cffe3157ac',ramdisk_id='',reservation_id='r-qta450zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1486248520',owner_user_name='tempest-ServerActionsTestOtherA-1486248520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T13:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aff1acfbf504e3ca9fadaf662314da0',uuid=6c2a8ccb-6b67-457c-bd6e-2c93161315e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converting VIF {"id": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "address": "fa:16:3e:74:da:4e", "network": {"id": "ebcba34c-034f-4e3e-a358-37024c1db2af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1153006567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89d23e2540d949c28d9db7cffe3157ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400ba332-96", "ovs_interfaceid": "400ba332-96ca-4bf2-9c81-f2a4acd7c6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG os_vif [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap400ba332-96, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ead5214-386e-4bd8-b6c6-3cbd02a8bd7d) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:04 user nova-compute[74582]: INFO os_vif [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:da:4e,bridge_name='br-int',has_traffic_filtering=True,id=400ba332-96ca-4bf2-9c81-f2a4acd7c6a9,network=Network(ebcba34c-034f-4e3e-a358-37024c1db2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400ba332-96')
Nov 03 14:27:04 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Deleting instance files /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3_del
Nov 03 14:27:04 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Deletion of /opt/stack/data/nova/instances/6c2a8ccb-6b67-457c-bd6e-2c93161315e3_del complete
Nov 03 14:27:04 user nova-compute[74582]: INFO nova.compute.manager [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 14:27:04 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:27:04 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:27:05 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:27:05 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Took 0.45 seconds to deallocate network for instance.
Nov 03 14:27:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:05 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:27:05 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:27:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:05 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Deleted allocations for instance 6c2a8ccb-6b67-457c-bd6e-2c93161315e3
Nov 03 14:27:05 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-485e52a2-3799-4762-bcc3-09deef6d9b50 tempest-ServerActionsTestOtherA-1486248520 tempest-ServerActionsTestOtherA-1486248520-project-member] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] Acquiring lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] Lock "6c2a8ccb-6b67-457c-bd6e-2c93161315e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] No waiting events found dispatching network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:27:06 user nova-compute[74582]: WARNING nova.compute.manager [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received unexpected event network-vif-plugged-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 for instance with vm_state deleted and task_state None.
Nov 03 14:27:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-0c57202a-b860-488d-bf5c-d3469edd08d4 req-18d5c608-2bdf-4c4a-b2fa-0626b18cca72 service nova] [instance: 6c2a8ccb-6b67-457c-bd6e-2c93161315e3] Received event network-vif-deleted-400ba332-96ca-4bf2-9c81-f2a4acd7c6a9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:27:14 user nova-compute[74582]: INFO nova.compute.manager [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Unrescuing
Nov 03 14:27:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:27:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:27:14 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:27:15 user nova-compute[74582]: DEBUG nova.network.neutron [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:27:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:27:15 user nova-compute[74582]: DEBUG nova.objects.instance [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'flavor' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:27:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcf452ec-4bd4-4a7f-81bb-0efacf5bbaf7 req-544aa258-7585-4714-b5f4-8e0bfd7ab8a7 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcf452ec-4bd4-4a7f-81bb-0efacf5bbaf7 req-544aa258-7585-4714-b5f4-8e0bfd7ab8a7 service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcf452ec-4bd4-4a7f-81bb-0efacf5bbaf7 req-544aa258-7585-4714-b5f4-8e0bfd7ab8a7 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:16 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fcf452ec-4bd4-4a7f-81bb-0efacf5bbaf7 req-544aa258-7585-4714-b5f4-8e0bfd7ab8a7 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:16 user nova-compute[74582]: DEBUG nova.compute.manager [req-fcf452ec-4bd4-4a7f-81bb-0efacf5bbaf7 req-544aa258-7585-4714-b5f4-8e0bfd7ab8a7 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:27:16 user nova-compute[74582]: WARNING nova.compute.manager [req-fcf452ec-4bd4-4a7f-81bb-0efacf5bbaf7 req-544aa258-7585-4714-b5f4-8e0bfd7ab8a7 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:27:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance destroyed successfully.
Nov 03 14:27:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:27:18 user nova-compute[74582]: WARNING nova.compute.manager [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:27:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:18 user nova-compute[74582]: DEBUG nova.compute.manager [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:27:18 user nova-compute[74582]: WARNING nova.compute.manager [req-f26cf7cb-b33c-47cf-829e-b4d3ba2bce94 req-60aa0d49-f50d-4353-bbf6-19f1dc53447c service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state rescued and task_state unrescuing.
Nov 03 14:27:19 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-dd37b5d4-b33e-4c03-bd5e-1d278f9c8099 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:27:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-1ccf0659-deb7-4273-a7bc-9d04a90ddea5 req-23f11d54-03b0-4aa6-8850-6c8ada9bdc32 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1ccf0659-deb7-4273-a7bc-9d04a90ddea5 req-23f11d54-03b0-4aa6-8850-6c8ada9bdc32 service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1ccf0659-deb7-4273-a7bc-9d04a90ddea5 req-23f11d54-03b0-4aa6-8850-6c8ada9bdc32 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1ccf0659-deb7-4273-a7bc-9d04a90ddea5 req-23f11d54-03b0-4aa6-8850-6c8ada9bdc32 service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-1ccf0659-deb7-4273-a7bc-9d04a90ddea5 req-23f11d54-03b0-4aa6-8850-6c8ada9bdc32 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:27:20 user nova-compute[74582]: WARNING nova.compute.manager [req-1ccf0659-deb7-4273-a7bc-9d04a90ddea5 req-23f11d54-03b0-4aa6-8850-6c8ada9bdc32 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state active and task_state None.
Nov 03 14:27:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:20 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:27:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:27:31 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [{"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-9658a040-77d8-45da-bb65-930ee5466b1c" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:27:33 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:34 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:35 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:27:36 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:27:36 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=24.999866485595703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:27:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:27:43 user nova-compute[74582]: INFO nova.compute.claims [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Claim successful on node user
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:27:43 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:27:43 user nova-compute[74582]: INFO nova.virt.block_device [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Booting with volume f67f1712-cfb0-4ed5-8af6-d6bdece05f7b at /dev/vda
Nov 03 14:27:43 user nova-compute[74582]: DEBUG nova.policy [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c726e17f780a483b8b3a220dfc34125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333545c5c61843ac89215bcc49b520e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG os_brick.utils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b326fa-8bca-4821-bba2-be02e06dce62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d410d-2065-48e3-8639-d4ea41f383a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3457401b-62ed-4e28-9a8e-8725583af258]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8da2a-21d0-4f28-abae-a6e155baefdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:27:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:27:44 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:27:44 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c0dde7-6563-432d-80c4-cf835bec74c5]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG os_brick.utils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating existing volume attachment record: 1b1d8a18-546c-43fb-864d-fe9b1edb3137 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Successfully created port: 030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:27:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Successfully updated port: 030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquired lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-changed-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Refreshing instance network info cache due to event network-changed-030ab83d-a107-4f9a-a3ae-a99f77d10a83. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] Acquiring lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Releasing lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Instance network_info: |[{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] Acquired lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Refreshing network info cache for port 030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updated VIF entry in instance network info cache for port 030ab83d-a107-4f9a-a3ae-a99f77d10a83. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:27:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ae8d4f11-8a87-4955-92e4-1b07ba9f8cd4 req-c9343c42-9818-4ab3-9e06-126aea147477 service nova] Releasing lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:27:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:27:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:28:03 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Creating image(s)
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Ensure instance console log exists: /opt/stack/data/nova/instances/66979d44-fe4c-45e6-b642-dc45bfa6adcb/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Start _get_guest_xml network_info=[{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1b1d8a18-546c-43fb-864d-fe9b1edb3137', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66979d44-fe4c-45e6-b642-dc45bfa6adcb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'serial': 'f67f1712-cfb0-4ed5-8af6-d6bdece05f7b'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:28:03 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:28:03 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:28:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:28:03 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:28:03 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f3549a-d96d-4801-b8a7-a55f408bef09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:28:03 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c306afc1-c1dc-4ffe-87be-6957009d2b49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b] added
Nov 03 14:28:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f8a1f-2c9a-499d-895f-2e3c602da96c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[44553ab1-2304-40cf-acb3-9e36f38d0b1c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVMNRgaO {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVMNRgaO" returned: 0 in 0.033s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797ac92-fc75-4ecf-9e8f-2d0f6ee78e68]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVMNRgaO'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e4d12-9e43-40a2-8676-c23f8a85f761]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985ebec-bea2-43c7-bf99-8eb1917adcc6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:28:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:28:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e812a7-7695-4aa0-812a-13972e86e114]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]
Nov 03 14:28:03 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.
Nov 03 14:28:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8c604e-a751-4312-a912-fddff83797d0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c879c7c-eea0-4398-9ecd-ff54ed476238]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:28:03 user nova-compute[74582]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:28:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:28:03 user nova-compute[74582]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:28:03 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eae3a0-5d70-4ce9-8d04-e1af8831b181]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:28:03 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23965316334313437', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965316334313437', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-979050074',display_name='tempest-TestVolumeBootPattern-server-979050074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-979050074',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-f94o93mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:27:44Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=66979d44-fe4c-45e6-b642-dc45bfa6adcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'pci_devices' on Instance uuid 66979d44-fe4c-45e6-b642-dc45bfa6adcb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:28:04 user nova-compute[74582]:   <uuid>66979d44-fe4c-45e6-b642-dc45bfa6adcb</uuid>
Nov 03 14:28:04 user nova-compute[74582]:   <name>instance-00000031</name>
Nov 03 14:28:04 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:28:04 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:28:04 user nova-compute[74582]:   <metadata>
Nov 03 14:28:04 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:28:04 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:28:04 user nova-compute[74582]:       <nova:name>tempest-TestVolumeBootPattern-server-979050074</nova:name>
Nov 03 14:28:04 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:28:03</nova:creationTime>
Nov 03 14:28:04 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:28:04 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:28:04 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:28:04 user nova-compute[74582]:       <nova:owner>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:user uuid="c726e17f780a483b8b3a220dfc34125d">tempest-TestVolumeBootPattern-1092687553-project-member</nova:user>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:project uuid="333545c5c61843ac89215bcc49b520e3">tempest-TestVolumeBootPattern-1092687553</nova:project>
Nov 03 14:28:04 user nova-compute[74582]:       </nova:owner>
Nov 03 14:28:04 user nova-compute[74582]:       <nova:ports>
Nov 03 14:28:04 user nova-compute[74582]:         <nova:port uuid="030ab83d-a107-4f9a-a3ae-a99f77d10a83">
Nov 03 14:28:04 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 14:28:04 user nova-compute[74582]:         </nova:port>
Nov 03 14:28:04 user nova-compute[74582]:       </nova:ports>
Nov 03 14:28:04 user nova-compute[74582]:     </nova:instance>
Nov 03 14:28:04 user nova-compute[74582]:   </metadata>
Nov 03 14:28:04 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:28:04 user nova-compute[74582]:     <system>
Nov 03 14:28:04 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:28:04 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:28:04 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:28:04 user nova-compute[74582]:       <entry name="serial">66979d44-fe4c-45e6-b642-dc45bfa6adcb</entry>
Nov 03 14:28:04 user nova-compute[74582]:       <entry name="uuid">66979d44-fe4c-45e6-b642-dc45bfa6adcb</entry>
Nov 03 14:28:04 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:28:04 user nova-compute[74582]:     </system>
Nov 03 14:28:04 user nova-compute[74582]:   </sysinfo>
Nov 03 14:28:04 user nova-compute[74582]:   <os>
Nov 03 14:28:04 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:28:04 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:28:04 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:28:04 user nova-compute[74582]:   </os>
Nov 03 14:28:04 user nova-compute[74582]:   <features>
Nov 03 14:28:04 user nova-compute[74582]:     <acpi/>
Nov 03 14:28:04 user nova-compute[74582]:     <apic/>
Nov 03 14:28:04 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:28:04 user nova-compute[74582]:   </features>
Nov 03 14:28:04 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:28:04 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:28:04 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:28:04 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:28:04 user nova-compute[74582]:   </clock>
Nov 03 14:28:04 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:28:04 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:28:04 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:28:04 user nova-compute[74582]:   </cpu>
Nov 03 14:28:04 user nova-compute[74582]:   <devices>
Nov 03 14:28:04 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:28:04 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:28:04 user nova-compute[74582]:       <source dev="/dev/sdb"/>
Nov 03 14:28:04 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:28:04 user nova-compute[74582]:       <serial>f67f1712-cfb0-4ed5-8af6-d6bdece05f7b</serial>
Nov 03 14:28:04 user nova-compute[74582]:     </disk>
Nov 03 14:28:04 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:28:04 user nova-compute[74582]:       <mac address="fa:16:3e:93:f3:1a"/>
Nov 03 14:28:04 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:28:04 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:28:04 user nova-compute[74582]:       <target dev="tap030ab83d-a1"/>
Nov 03 14:28:04 user nova-compute[74582]:     </interface>
Nov 03 14:28:04 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:28:04 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/66979d44-fe4c-45e6-b642-dc45bfa6adcb/console.log" append="off"/>
Nov 03 14:28:04 user nova-compute[74582]:     </serial>
Nov 03 14:28:04 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:28:04 user nova-compute[74582]:     <video>
Nov 03 14:28:04 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:28:04 user nova-compute[74582]:     </video>
Nov 03 14:28:04 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:28:04 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:28:04 user nova-compute[74582]:     </rng>
Nov 03 14:28:04 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:28:04 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:28:04 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:28:04 user nova-compute[74582]:     </memballoon>
Nov 03 14:28:04 user nova-compute[74582]:   </devices>
Nov 03 14:28:04 user nova-compute[74582]: </domain>
Nov 03 14:28:04 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-979050074',display_name='tempest-TestVolumeBootPattern-server-979050074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-979050074',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-f94o93mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:27:44Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=66979d44-fe4c-45e6-b642-dc45bfa6adcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG os_vif [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07fc95da-dd68-53bd-80aa-d5e3398d877e', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap030ab83d-a1, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap030ab83d-a1, col_values=(('qos', UUID('01a64918-7a24-4d2c-a848-7f7ba2535c0d')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap030ab83d-a1, col_values=(('external_ids', {'iface-id': '030ab83d-a107-4f9a-a3ae-a99f77d10a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f3:1a', 'vm-uuid': '66979d44-fe4c-45e6-b642-dc45bfa6adcb'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:04 user nova-compute[74582]: INFO os_vif [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1')
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:28:04 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No VIF found with MAC fa:16:3e:93:f3:1a, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:28:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e20d183-b735-46f7-82da-8ad003aa13ba req-5e1fe5db-391e-4a40-bfcc-dcecfb13113b service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e20d183-b735-46f7-82da-8ad003aa13ba req-5e1fe5db-391e-4a40-bfcc-dcecfb13113b service nova] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e20d183-b735-46f7-82da-8ad003aa13ba req-5e1fe5db-391e-4a40-bfcc-dcecfb13113b service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1e20d183-b735-46f7-82da-8ad003aa13ba req-5e1fe5db-391e-4a40-bfcc-dcecfb13113b service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-1e20d183-b735-46f7-82da-8ad003aa13ba req-5e1fe5db-391e-4a40-bfcc-dcecfb13113b service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] No waiting events found dispatching network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:28:06 user nova-compute[74582]: WARNING nova.compute.manager [req-1e20d183-b735-46f7-82da-8ad003aa13ba req-5e1fe5db-391e-4a40-bfcc-dcecfb13113b service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received unexpected event network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 for instance with vm_state building and task_state spawning.
Nov 03 14:28:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 1 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance has had 3 of 5 cleanup attempts {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 03 14:28:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deletion of /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize failed
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:28:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Instance spawned successfully.
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:28:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:28:08 user nova-compute[74582]: INFO nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 03 14:28:08 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:28:08 user nova-compute[74582]: INFO nova.compute.manager [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Took 24.82 seconds to build instance.
Nov 03 14:28:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c4ed0243-0adf-4dc9-b6ed-51fa8d353a40 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.912s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:28:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-6d6f387c-6a22-48e3-a6d1-dcbf70c26e83 req-cda77c16-9ecc-4bd6-8ba2-0a31b1f8685b service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:28:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6d6f387c-6a22-48e3-a6d1-dcbf70c26e83 req-cda77c16-9ecc-4bd6-8ba2-0a31b1f8685b service nova] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:28:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6d6f387c-6a22-48e3-a6d1-dcbf70c26e83 req-cda77c16-9ecc-4bd6-8ba2-0a31b1f8685b service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:28:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-6d6f387c-6a22-48e3-a6d1-dcbf70c26e83 req-cda77c16-9ecc-4bd6-8ba2-0a31b1f8685b service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:28:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-6d6f387c-6a22-48e3-a6d1-dcbf70c26e83 req-cda77c16-9ecc-4bd6-8ba2-0a31b1f8685b service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] No waiting events found dispatching network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:28:08 user nova-compute[74582]: WARNING nova.compute.manager [req-6d6f387c-6a22-48e3-a6d1-dcbf70c26e83 req-cda77c16-9ecc-4bd6-8ba2-0a31b1f8685b service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received unexpected event network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 for instance with vm_state active and task_state None.
Nov 03 14:28:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:16 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:17 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:28:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:28:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:28:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:28:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:28:34 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:28:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:28:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=24.988571166992188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:28:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:28:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:28:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:28:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:28:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:28:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:28:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:29:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:29:06 user nova-compute[74582]: DEBUG nova.compute.manager [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing instance network info cache due to event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:29:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:29:06 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:29:06 user nova-compute[74582]: DEBUG nova.network.neutron [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:07 user nova-compute[74582]: INFO nova.compute.manager [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Detaching volume d5229e4d-234d-4619-bbdb-740281ff0359
Nov 03 14:29:07 user nova-compute[74582]: INFO nova.virt.block_device [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Attempting to driver detach volume d5229e4d-234d-4619-bbdb-740281ff0359 from mountpoint /dev/vdb
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Attempting to detach device vdb from instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:29:07 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:29:07 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:29:07 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:29:07 user nova-compute[74582]:   <serial>d5229e4d-234d-4619-bbdb-740281ff0359</serial>
Nov 03 14:29:07 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:29:07 user nova-compute[74582]: </disk>
Nov 03 14:29:07 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:29:07 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully detached device vdb from instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 from the persistent domain config.
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:29:07 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:29:07 user nova-compute[74582]:   <source dev="/dev/sdd"/>
Nov 03 14:29:07 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:29:07 user nova-compute[74582]:   <serial>d5229e4d-234d-4619-bbdb-740281ff0359</serial>
Nov 03 14:29:07 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:29:07 user nova-compute[74582]: </disk>
Nov 03 14:29:07 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.network.neutron [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updated VIF entry in instance network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.network.neutron [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-ade721d9-92de-42cb-b2ac-9628be27680e req-5bdb7c94-e633-4e16-b88d-5c5436fd9f50 service nova] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:29:07 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:29:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:29:08 user nova-compute[74582]: DEBUG nova.compute.manager [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing instance network info cache due to event network-changed-3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:29:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] Acquiring lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:29:08 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] Acquired lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:29:08 user nova-compute[74582]: DEBUG nova.network.neutron [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Refreshing network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:29:09 user nova-compute[74582]: DEBUG nova.network.neutron [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updated VIF entry in instance network info cache for port 3ce9a11b-6762-48b0-ab18-ba10fb6293d9. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:29:09 user nova-compute[74582]: DEBUG nova.network.neutron [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [{"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:29:09 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7df5ba48-2339-4dcf-b8c6-4ce7143d0dea req-2e339e8a-d4b0-41c2-980d-0dde69d306b1 service nova] Releasing lock "refresh_cache-3f0c48a9-4035-40ea-916a-e5cf4c6211a6" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:29:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:22 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:29:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:29:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:27 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 is timed out.
Nov 03 14:29:27 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully detached device vdb from instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 from the live domain config.
Nov 03 14:29:27 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBKeuONx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:29:27 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8820353b-dbf2-45df-b136-9c0174b9e746]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:29:27 user nova-compute[74582]: No targets found.
Nov 03 14:29:27 user nova-compute[74582]: iSNS:
Nov 03 14:29:27 user nova-compute[74582]: No targets found.
Nov 03 14:29:27 user nova-compute[74582]: STATIC:
Nov 03 14:29:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359
Nov 03 14:29:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:29:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:29:27 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b
Nov 03 14:29:27 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:29:27 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:29:27 user nova-compute[74582]: FIRMWARE:
Nov 03 14:29:27 user nova-compute[74582]: No targets found.
Nov 03 14:29:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:29:27 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:29:27 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d905dbb-3dce-418e-bc21-c5d31337ba1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[253e2886-477e-4a36-879b-4a7b573b89da]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:29:27 user nova-compute[74582]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:29:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 (non-flash)
Nov 03 14:29:27 user nova-compute[74582]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:29:27 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f4878b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359'): ({'sdd'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Removing single pathed devices sdd {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c2495d-4bbb-455d-8c4c-5702d6e62949]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b995db-edee-42df-a4ba-e982f6f76c74]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Flushing IO for device /dev/sdd {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce637476-6d75-4b5c-bd88-96978533c6f1]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:29:27 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b525ae-2532-4b28-8a72-ead9c35b9978]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] SCSI volumes sdd have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a092e3-59b5-4e6a-84f8-65566bbf9b56]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4669ec-e27a-4a0b-8cd3-33c22312b571]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260]
Nov 03 14:29:28 user nova-compute[74582]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359, portal: 172.16.0.220,3260] successful.
Nov 03 14:29:28 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5229e4d-234d-4619-bbdb-740281ff0359 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65e7317-4e4e-4b89-ac80-f501ed8ec98e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] <== disconnect_volume: return (308ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:29:28 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:29 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:31 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:33 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'flavor' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:29:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8594647-1142-4e2e-9365-049e79d8dea7 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.464s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG nova.compute.manager [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-changed-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG nova.compute.manager [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Refreshing instance network info cache due to event network-changed-030ab83d-a107-4f9a-a3ae-a99f77d10a83. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] Acquiring lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] Acquired lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:29:34 user nova-compute[74582]: DEBUG nova.network.neutron [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Refreshing network info cache for port 030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG nova.network.neutron [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updated VIF entry in instance network info cache for port 030ab83d-a107-4f9a-a3ae-a99f77d10a83. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG nova.network.neutron [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-888742a2-9daa-4bf1-89d5-08a0adf84d0a req-6553db97-7ad4-455a-945b-60ad4769a453 service nova] Releasing lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:35 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:29:37 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=24.986530303955078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:29:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:38 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:29:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:29:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 14:29:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:44 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:29:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:29:49 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:29:54 user nova-compute[74582]: INFO nova.compute.claims [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Claim successful on node user
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:54 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.policy [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c726e17f780a483b8b3a220dfc34125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333545c5c61843ac89215bcc49b520e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:29:54 user nova-compute[74582]: INFO nova.virt.block_device [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Booting with volume 66ce1c09-95d7-4c45-921c-58928672acf8 at /dev/vda
Nov 03 14:29:54 user nova-compute[74582]: DEBUG os_brick.utils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af2778-932f-4e08-9676-1f50cf8e707c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c895b-e5e1-4e3f-bd6d-14f97b550047]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[47acc8f8-7c60-4201-a29e-ebd61bab3a3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76472462-defd-4dab-8e6c-d1d6b7870606]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:29:54 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:29:54 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c7521-c348-4b11-91c3-0621e20a57b6]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG os_brick.utils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:29:54 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating existing volume attachment record: b8411917-1196-49b8-85ce-9e5aa6417947 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:29:55 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Successfully created port: 2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Successfully updated port: 2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquired lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-changed-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.compute.manager [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Refreshing instance network info cache due to event network-changed-2a1c6df0-f805-4754-b4f1-719cafe30d4c. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] Acquiring lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating instance_info_cache with network_info: [{"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Releasing lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Instance network_info: |[{"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] Acquired lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:29:56 user nova-compute[74582]: DEBUG nova.network.neutron [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Refreshing network info cache for port 2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updated VIF entry in instance network info cache for port 2a1c6df0-f805-4754-b4f1-719cafe30d4c. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG nova.network.neutron [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating instance_info_cache with network_info: [{"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-fc2c66a7-e88a-4c00-943c-fc4ed59d028b req-f80865b1-979f-4fd7-ac26-f78ad86bc82a service nova] Releasing lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:57 user nova-compute[74582]: INFO nova.compute.manager [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Terminating instance
Nov 03 14:29:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Instance destroyed successfully.
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'resources' on Instance uuid 3f0c48a9-4035-40ea-916a-e5cf4c6211a6 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2145595895',display_name='tempest-ServerRescueNegativeTestJSON-server-2145595895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2145595895',id=47,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3c1Ux1Z2wLbITfjUOU2pJe71r0I8x7RXulucj0HJaMEWWNNb1q5R43npg42OjJhO2+mQ6RVGMttSCTfIf1ZK5BKlRNx5O7glXv2TAVqD0TnBohOoBt3Hr7L7khiDNN2w==',key_name='tempest-keypair-863759506',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-q5sju0s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cb25ef9de143a5a55d341a089e19de',uuid=3f0c48a9-4035-40ea-916a-e5cf4c6211a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "address": "fa:16:3e:0e:d7:92", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce9a11b-67", "ovs_interfaceid": "3ce9a11b-6762-48b0-ab18-ba10fb6293d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG os_vif [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce9a11b-67, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61c5fc90-44bc-4735-aeba-85a59d127d7b) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:29:58 user nova-compute[74582]: INFO os_vif [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d7:92,bridge_name='br-int',has_traffic_filtering=True,id=3ce9a11b-6762-48b0-ab18-ba10fb6293d9,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce9a11b-67')
Nov 03 14:29:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Deleting instance files /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6_del
Nov 03 14:29:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Deletion of /opt/stack/data/nova/instances/3f0c48a9-4035-40ea-916a-e5cf4c6211a6_del complete
Nov 03 14:29:58 user nova-compute[74582]: INFO nova.compute.manager [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-unplugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] Acquiring lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:58 user nova-compute[74582]: DEBUG nova.compute.manager [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] No waiting events found dispatching network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:29:58 user nova-compute[74582]: WARNING nova.compute.manager [req-3abf70e6-cc50-4529-a613-74abc8670ae7 req-a411ea9e-20d0-4204-a242-5dbfd986380b service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received unexpected event network-vif-plugged-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 for instance with vm_state active and task_state deleting.
Nov 03 14:29:59 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:29:59 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Took 0.84 seconds to deallocate network for instance.
Nov 03 14:29:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:29:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:29:59 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:29:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:29:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:29:59 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Deleted allocations for instance 3f0c48a9-4035-40ea-916a-e5cf4c6211a6
Nov 03 14:29:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-d88b377a-121d-468d-a91a-0536e3debd47 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "3f0c48a9-4035-40ea-916a-e5cf4c6211a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:00 user nova-compute[74582]: DEBUG nova.compute.manager [req-7e00b250-9b4a-4571-9cad-4a8a00230daa req-c28aa1f3-8410-4884-a4bb-6bbd319e587e service nova] [instance: 3f0c48a9-4035-40ea-916a-e5cf4c6211a6] Received event network-vif-deleted-3ce9a11b-6762-48b0-ab18-ba10fb6293d9 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:30:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:30:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Creating image(s)
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Did not create local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Ensure instance console log exists: /opt/stack/data/nova/instances/b88e66f6-9d59-4ef9-9bac-bf94a99d35fc/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Start _get_guest_xml network_info=[{"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b8411917-1196-49b8-85ce-9e5aa6417947', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whRtOjKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b88e66f6-9d59-4ef9-9bac-bf94a99d35fc', 'attached_at': '', 'detached_at': '', 'volume_id': '66ce1c09-95d7-4c45-921c-58928672acf8', 'serial': '66ce1c09-95d7-4c45-921c-58928672acf8'}, 'volume_type': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:30:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:30:14 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whRtOjKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:30:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:30:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:30:14 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:30:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:30:14 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d28f582-73aa-4302-9fda-efdb41890b65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:30:14 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:14 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45815b-d740-4261-b253-99f7dd021e9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8] added
Nov 03 14:30:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b9c22e-5a1e-41c9-8a49-5cc1af57daf3]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[09001f43-1116-4e68-b190-851a1c0cfb5c]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whRtOjKr {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whRtOjKr" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de82670b-ed5d-47d6-aece-cddf21b839d8]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'whRtOjKr'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd2ccb1-b7e6-4ab9-8deb-4d878e8a67cd]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8716fa2-abf2-4de2-a242-4bda08937694]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:30:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:30:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63d042-3ddf-4c1c-92fd-4236e006e84a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260]
Nov 03 14:30:15 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260] successful.
Nov 03 14:30:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad328e1a-1706-4efa-84c1-6e6385e08fdf]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c11ecd-5fe4-4105-a048-0ec733466719]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:30:15 user nova-compute[74582]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 (non-flash)
Nov 03 14:30:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:30:15 user nova-compute[74582]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 (non-flash)
Nov 03 14:30:15 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe8734-62bd-4ba3-9d3e-0b87e1ad1432]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:30:15 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whRtOjKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23565346436336134', 'path': '/dev/sdc'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565346436336134', 'path': '/dev/sdc'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-10779643',display_name='tempest-TestVolumeBootPattern-server-10779643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-10779643',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-9yrdvptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:29:55Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=b88e66f6-9d59-4ef9-9bac-bf94a99d35fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'pci_devices' on Instance uuid b88e66f6-9d59-4ef9-9bac-bf94a99d35fc {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:30:16 user nova-compute[74582]:   <uuid>b88e66f6-9d59-4ef9-9bac-bf94a99d35fc</uuid>
Nov 03 14:30:16 user nova-compute[74582]:   <name>instance-00000032</name>
Nov 03 14:30:16 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:30:16 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:30:16 user nova-compute[74582]:   <metadata>
Nov 03 14:30:16 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:30:16 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:30:16 user nova-compute[74582]:       <nova:name>tempest-TestVolumeBootPattern-server-10779643</nova:name>
Nov 03 14:30:16 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:30:14</nova:creationTime>
Nov 03 14:30:16 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:30:16 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:30:16 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:30:16 user nova-compute[74582]:       <nova:owner>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:user uuid="c726e17f780a483b8b3a220dfc34125d">tempest-TestVolumeBootPattern-1092687553-project-member</nova:user>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:project uuid="333545c5c61843ac89215bcc49b520e3">tempest-TestVolumeBootPattern-1092687553</nova:project>
Nov 03 14:30:16 user nova-compute[74582]:       </nova:owner>
Nov 03 14:30:16 user nova-compute[74582]:       <nova:ports>
Nov 03 14:30:16 user nova-compute[74582]:         <nova:port uuid="2a1c6df0-f805-4754-b4f1-719cafe30d4c">
Nov 03 14:30:16 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 14:30:16 user nova-compute[74582]:         </nova:port>
Nov 03 14:30:16 user nova-compute[74582]:       </nova:ports>
Nov 03 14:30:16 user nova-compute[74582]:     </nova:instance>
Nov 03 14:30:16 user nova-compute[74582]:   </metadata>
Nov 03 14:30:16 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:30:16 user nova-compute[74582]:     <system>
Nov 03 14:30:16 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:30:16 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:30:16 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:30:16 user nova-compute[74582]:       <entry name="serial">b88e66f6-9d59-4ef9-9bac-bf94a99d35fc</entry>
Nov 03 14:30:16 user nova-compute[74582]:       <entry name="uuid">b88e66f6-9d59-4ef9-9bac-bf94a99d35fc</entry>
Nov 03 14:30:16 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:30:16 user nova-compute[74582]:     </system>
Nov 03 14:30:16 user nova-compute[74582]:   </sysinfo>
Nov 03 14:30:16 user nova-compute[74582]:   <os>
Nov 03 14:30:16 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:30:16 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:30:16 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:30:16 user nova-compute[74582]:   </os>
Nov 03 14:30:16 user nova-compute[74582]:   <features>
Nov 03 14:30:16 user nova-compute[74582]:     <acpi/>
Nov 03 14:30:16 user nova-compute[74582]:     <apic/>
Nov 03 14:30:16 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:30:16 user nova-compute[74582]:   </features>
Nov 03 14:30:16 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:30:16 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:30:16 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:30:16 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:30:16 user nova-compute[74582]:   </clock>
Nov 03 14:30:16 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:30:16 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:30:16 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:30:16 user nova-compute[74582]:   </cpu>
Nov 03 14:30:16 user nova-compute[74582]:   <devices>
Nov 03 14:30:16 user nova-compute[74582]:     <disk type="block" device="disk">
Nov 03 14:30:16 user nova-compute[74582]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:30:16 user nova-compute[74582]:       <source dev="/dev/sdc"/>
Nov 03 14:30:16 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:30:16 user nova-compute[74582]:       <serial>66ce1c09-95d7-4c45-921c-58928672acf8</serial>
Nov 03 14:30:16 user nova-compute[74582]:     </disk>
Nov 03 14:30:16 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:30:16 user nova-compute[74582]:       <mac address="fa:16:3e:ff:2a:62"/>
Nov 03 14:30:16 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:30:16 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:30:16 user nova-compute[74582]:       <target dev="tap2a1c6df0-f8"/>
Nov 03 14:30:16 user nova-compute[74582]:     </interface>
Nov 03 14:30:16 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:30:16 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/b88e66f6-9d59-4ef9-9bac-bf94a99d35fc/console.log" append="off"/>
Nov 03 14:30:16 user nova-compute[74582]:     </serial>
Nov 03 14:30:16 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:30:16 user nova-compute[74582]:     <video>
Nov 03 14:30:16 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:30:16 user nova-compute[74582]:     </video>
Nov 03 14:30:16 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:30:16 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:30:16 user nova-compute[74582]:     </rng>
Nov 03 14:30:16 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:30:16 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:30:16 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:30:16 user nova-compute[74582]:     </memballoon>
Nov 03 14:30:16 user nova-compute[74582]:   </devices>
Nov 03 14:30:16 user nova-compute[74582]: </domain>
Nov 03 14:30:16 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-10779643',display_name='tempest-TestVolumeBootPattern-server-10779643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-10779643',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-9yrdvptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:29:55Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=b88e66f6-9d59-4ef9-9bac-bf94a99d35fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG os_vif [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9b89d88-314f-556c-acd6-2681af5ef03e', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a1c6df0-f8, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a1c6df0-f8, col_values=(('qos', UUID('a4db4047-c783-47d0-9ff0-b2af3bc8fdf9')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a1c6df0-f8, col_values=(('external_ids', {'iface-id': '2a1c6df0-f805-4754-b4f1-719cafe30d4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:2a:62', 'vm-uuid': 'b88e66f6-9d59-4ef9-9bac-bf94a99d35fc'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:16 user nova-compute[74582]: INFO os_vif [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8')
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:30:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] No VIF found with MAC fa:16:3e:ff:2a:62, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-e37868c7-8513-4e74-8109-daa586e1d81a req-7a63f372-960d-436a-b778-1f1685e8e421 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e37868c7-8513-4e74-8109-daa586e1d81a req-7a63f372-960d-436a-b778-1f1685e8e421 service nova] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e37868c7-8513-4e74-8109-daa586e1d81a req-7a63f372-960d-436a-b778-1f1685e8e421 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e37868c7-8513-4e74-8109-daa586e1d81a req-7a63f372-960d-436a-b778-1f1685e8e421 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:17 user nova-compute[74582]: DEBUG nova.compute.manager [req-e37868c7-8513-4e74-8109-daa586e1d81a req-7a63f372-960d-436a-b778-1f1685e8e421 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] No waiting events found dispatching network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:30:17 user nova-compute[74582]: WARNING nova.compute.manager [req-e37868c7-8513-4e74-8109-daa586e1d81a req-7a63f372-960d-436a-b778-1f1685e8e421 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received unexpected event network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c for instance with vm_state building and task_state spawning.
Nov 03 14:30:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:30:19 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Instance spawned successfully.
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:30:19 user nova-compute[74582]: INFO nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 03 14:30:19 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:30:19 user nova-compute[74582]: INFO nova.compute.manager [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Took 25.66 seconds to build instance.
Nov 03 14:30:19 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9fc7eb58-38ac-47c4-a75a-e0f039063d11 tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.774s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-46326860-ce19-4ff7-9c81-375e68560e74 req-85e1445e-dcf9-412e-9cd6-a621e7a47ba2 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-46326860-ce19-4ff7-9c81-375e68560e74 req-85e1445e-dcf9-412e-9cd6-a621e7a47ba2 service nova] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-46326860-ce19-4ff7-9c81-375e68560e74 req-85e1445e-dcf9-412e-9cd6-a621e7a47ba2 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-46326860-ce19-4ff7-9c81-375e68560e74 req-85e1445e-dcf9-412e-9cd6-a621e7a47ba2 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG nova.compute.manager [req-46326860-ce19-4ff7-9c81-375e68560e74 req-85e1445e-dcf9-412e-9cd6-a621e7a47ba2 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] No waiting events found dispatching network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:30:20 user nova-compute[74582]: WARNING nova.compute.manager [req-46326860-ce19-4ff7-9c81-375e68560e74 req-85e1445e-dcf9-412e-9cd6-a621e7a47ba2 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received unexpected event network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c for instance with vm_state active and task_state None.
Nov 03 14:30:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:22 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:23 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:30:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:28 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:31 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:30:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:30:38 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:30:38 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.012184143066406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 9658a040-77d8-45da-bb65-930ee5466b1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b88e66f6-9d59-4ef9-9bac-bf94a99d35fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:30:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [{"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:30:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:30:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:30:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:31:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9658a040-77d8-45da-bb65-930ee5466b1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:10 user nova-compute[74582]: INFO nova.compute.manager [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Terminating instance
Nov 03 14:31:10 user nova-compute[74582]: DEBUG nova.compute.manager [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-63a7f959-21fa-4799-9e51-9d1708c88616 req-47634449-7bfe-421a-be85-c3ea33915411 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63a7f959-21fa-4799-9e51-9d1708c88616 req-47634449-7bfe-421a-be85-c3ea33915411 service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63a7f959-21fa-4799-9e51-9d1708c88616 req-47634449-7bfe-421a-be85-c3ea33915411 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-63a7f959-21fa-4799-9e51-9d1708c88616 req-47634449-7bfe-421a-be85-c3ea33915411 service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-63a7f959-21fa-4799-9e51-9d1708c88616 req-47634449-7bfe-421a-be85-c3ea33915411 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:31:10 user nova-compute[74582]: DEBUG nova.compute.manager [req-63a7f959-21fa-4799-9e51-9d1708c88616 req-47634449-7bfe-421a-be85-c3ea33915411 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-unplugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:31:11 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Instance destroyed successfully.
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.objects.instance [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'resources' on Instance uuid 9658a040-77d8-45da-bb65-930ee5466b1c {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015289643',display_name='tempest-ServerRescueNegativeTestJSON-server-2015289643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015289643',id=42,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:16:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-2n17jzb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:16:27Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=9658a040-77d8-45da-bb65-930ee5466b1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "address": "fa:16:3e:54:d3:74", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67faf6-cb", "ovs_interfaceid": "6a67faf6-cb27-45cf-8561-6a54e3d320ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG os_vif [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a67faf6-cb, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c694b171-92d7-4430-abac-1e1c94eccbe9) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:11 user nova-compute[74582]: INFO os_vif [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=6a67faf6-cb27-45cf-8561-6a54e3d320ad,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67faf6-cb')
Nov 03 14:31:11 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Deleting instance files /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c_del
Nov 03 14:31:11 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Deletion of /opt/stack/data/nova/instances/9658a040-77d8-45da-bb65-930ee5466b1c_del complete
Nov 03 14:31:11 user nova-compute[74582]: INFO nova.compute.manager [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 14:31:11 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:11 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Took 0.50 seconds to deallocate network for instance.
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-8fa04ca5-1754-4547-94fa-b20c29728707 req-9b1d1dc1-d3ac-40eb-93fe-7c8528e1ab84 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-deleted-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:11 user nova-compute[74582]: INFO nova.compute.manager [req-8fa04ca5-1754-4547-94fa-b20c29728707 req-9b1d1dc1-d3ac-40eb-93fe-7c8528e1ab84 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Neutron deleted interface 6a67faf6-cb27-45cf-8561-6a54e3d320ad; detaching it from the instance and deleting it from the info cache
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.network.neutron [req-8fa04ca5-1754-4547-94fa-b20c29728707 req-9b1d1dc1-d3ac-40eb-93fe-7c8528e1ab84 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.compute.manager [req-8fa04ca5-1754-4547-94fa-b20c29728707 req-9b1d1dc1-d3ac-40eb-93fe-7c8528e1ab84 service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Detach interface failed, port_id=6a67faf6-cb27-45cf-8561-6a54e3d320ad, reason: Instance 9658a040-77d8-45da-bb65-930ee5466b1c could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:31:11 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:12 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Deleted allocations for instance 9658a040-77d8-45da-bb65-930ee5466b1c
Nov 03 14:31:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-efb32861-ca08-452c-8c38-7d3f510e4159 tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "9658a040-77d8-45da-bb65-930ee5466b1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.827s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-b66f4bed-01f3-49bb-8a34-c00aac457053 req-71db211b-576f-472a-80bb-387f370dcf4e service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f4bed-01f3-49bb-8a34-c00aac457053 req-71db211b-576f-472a-80bb-387f370dcf4e service nova] Acquiring lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f4bed-01f3-49bb-8a34-c00aac457053 req-71db211b-576f-472a-80bb-387f370dcf4e service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:12 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b66f4bed-01f3-49bb-8a34-c00aac457053 req-71db211b-576f-472a-80bb-387f370dcf4e service nova] Lock "9658a040-77d8-45da-bb65-930ee5466b1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:12 user nova-compute[74582]: DEBUG nova.compute.manager [req-b66f4bed-01f3-49bb-8a34-c00aac457053 req-71db211b-576f-472a-80bb-387f370dcf4e service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] No waiting events found dispatching network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:31:12 user nova-compute[74582]: WARNING nova.compute.manager [req-b66f4bed-01f3-49bb-8a34-c00aac457053 req-71db211b-576f-472a-80bb-387f370dcf4e service nova] [instance: 9658a040-77d8-45da-bb65-930ee5466b1c] Received unexpected event network-vif-plugged-6a67faf6-cb27-45cf-8561-6a54e3d320ad for instance with vm_state deleted and task_state None.
Nov 03 14:31:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:20 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:31:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:33 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:36 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:31:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:31:38 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:31:38 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.039321899414062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance b88e66f6-9d59-4ef9-9bac-bf94a99d35fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:31:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:31:40 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:31:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:31:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:31:40 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:31:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:41 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:31:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:31:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-changed-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:45 user nova-compute[74582]: DEBUG nova.compute.manager [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Refreshing instance network info cache due to event network-changed-2a1c6df0-f805-4754-b4f1-719cafe30d4c. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:31:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] Acquiring lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:31:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] Acquired lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:31:45 user nova-compute[74582]: DEBUG nova.network.neutron [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Refreshing network info cache for port 2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updated VIF entry in instance network info cache for port 2a1c6df0-f805-4754-b4f1-719cafe30d4c. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating instance_info_cache with network_info: [{"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-9d6d1840-26f8-42c8-8d24-c67b769e49b6 req-ee17f1b3-53f5-499c-ac05-8cfefa700518 service nova] Releasing lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-changed-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG nova.compute.manager [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Refreshing instance network info cache due to event network-changed-2a1c6df0-f805-4754-b4f1-719cafe30d4c. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] Acquiring lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] Acquired lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:31:46 user nova-compute[74582]: DEBUG nova.network.neutron [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Refreshing network info cache for port 2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:47 user nova-compute[74582]: INFO nova.compute.manager [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Terminating instance
Nov 03 14:31:47 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG nova.network.neutron [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updated VIF entry in instance network info cache for port 2a1c6df0-f805-4754-b4f1-719cafe30d4c. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG nova.network.neutron [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating instance_info_cache with network_info: [{"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-75caccfe-9cac-4957-913e-18a1520669ce req-6a511768-0998-430d-bc81-e2841189b978 service nova] Releasing lock "refresh_cache-b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Instance destroyed successfully.
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'resources' on Instance uuid b88e66f6-9d59-4ef9-9bac-bf94a99d35fc {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-10779643',display_name='tempest-TestVolumeBootPattern-server-10779643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-10779643',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:30:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-9yrdvptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:30:20Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=b88e66f6-9d59-4ef9-9bac-bf94a99d35fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "address": "fa:16:3e:ff:2a:62", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1c6df0-f8", "ovs_interfaceid": "2a1c6df0-f805-4754-b4f1-719cafe30d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_vif [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a1c6df0-f8, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4db4047-c783-47d0-9ff0-b2af3bc8fdf9) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:31:48 user nova-compute[74582]: INFO os_vif [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:2a:62,bridge_name='br-int',has_traffic_filtering=True,id=2a1c6df0-f805-4754-b4f1-719cafe30d4c,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1c6df0-f8')
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whRtOjKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:31:48 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7883ef80-f6af-45eb-982a-da4d69a5e138]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:31:48 user nova-compute[74582]: No targets found.
Nov 03 14:31:48 user nova-compute[74582]: iSNS:
Nov 03 14:31:48 user nova-compute[74582]: No targets found.
Nov 03 14:31:48 user nova-compute[74582]: STATIC:
Nov 03 14:31:48 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8
Nov 03 14:31:48 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:31:48 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:31:48 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b
Nov 03 14:31:48 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:31:48 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:31:48 user nova-compute[74582]: FIRMWARE:
Nov 03 14:31:48 user nova-compute[74582]: No targets found.
Nov 03 14:31:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:31:48 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:31:48 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88824c48-6157-411a-8cbd-09de1705d604]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1987cf57-0df6-43e5-82bf-0dff14c74744]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:31:48 user nova-compute[74582]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 (non-flash)
Nov 03 14:31:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:31:48 user nova-compute[74582]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 (non-flash)
Nov 03 14:31:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f487168c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8'): ({'sdc'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Removing single pathed devices sdc {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a47198-0f5b-4bab-8fa3-2583edc82453]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1898d4a1-43bd-4fa3-ae46-d98bc3863086]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flushing IO for device /dev/sdc {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f15e354-7ccd-4873-bbec-7fbdb9409804]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8081147c-904d-452b-9558-f1059bd0fc3b]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] SCSI volumes sdc have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_21b67f1e',) {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a431695b-f001-416e-b87d-d67dde6fa223]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a356a5c-c9d0-46ff-afa9-44c9ccd6575a]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68afa87-631d-4e9a-ad97-76b4d27e1429]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260]
Nov 03 14:31:48 user nova-compute[74582]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8, portal: 172.16.0.220,3260] successful.
Nov 03 14:31:48 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66ce1c09-95d7-4c45-921c-58928672acf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274018f-7c75-435a-9887-14451a9650bc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== disconnect_volume: return (290ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:31:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Deleting instance files /opt/stack/data/nova/instances/b88e66f6-9d59-4ef9-9bac-bf94a99d35fc_del
Nov 03 14:31:48 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Deletion of /opt/stack/data/nova/instances/b88e66f6-9d59-4ef9-9bac-bf94a99d35fc_del complete
Nov 03 14:31:48 user nova-compute[74582]: INFO nova.compute.manager [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 03 14:31:48 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:31:48 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-vif-unplugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] No waiting events found dispatching network-vif-unplugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-vif-unplugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] Acquiring lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] No waiting events found dispatching network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:31:49 user nova-compute[74582]: WARNING nova.compute.manager [req-141b4cdd-7079-4b20-99e1-49228c55c407 req-b8f5a029-889c-4ab8-938a-c25041bd5318 service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received unexpected event network-vif-plugged-2a1c6df0-f805-4754-b4f1-719cafe30d4c for instance with vm_state active and task_state deleting.
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:49 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Took 0.55 seconds to deallocate network for instance.
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-f369e369-fe3f-4cc5-a851-a01130c0c00c req-ad00bafe-d115-4239-93db-d4cf668e2bee service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Received event network-vif-deleted-2a1c6df0-f805-4754-b4f1-719cafe30d4c {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:31:49 user nova-compute[74582]: INFO nova.compute.manager [req-f369e369-fe3f-4cc5-a851-a01130c0c00c req-ad00bafe-d115-4239-93db-d4cf668e2bee service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Neutron deleted interface 2a1c6df0-f805-4754-b4f1-719cafe30d4c; detaching it from the instance and deleting it from the info cache
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.network.neutron [req-f369e369-fe3f-4cc5-a851-a01130c0c00c req-ad00bafe-d115-4239-93db-d4cf668e2bee service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:31:49 user nova-compute[74582]: DEBUG nova.compute.manager [req-f369e369-fe3f-4cc5-a851-a01130c0c00c req-ad00bafe-d115-4239-93db-d4cf668e2bee service nova] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Detach interface failed, port_id=2a1c6df0-f805-4754-b4f1-719cafe30d4c, reason: Instance b88e66f6-9d59-4ef9-9bac-bf94a99d35fc could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:31:49 user nova-compute[74582]: INFO nova.compute.manager [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: b88e66f6-9d59-4ef9-9bac-bf94a99d35fc] Took 0.84 seconds to detach 1 volumes for instance.
Nov 03 14:31:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:31:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:31:50 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:31:50 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:31:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:50 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Deleted allocations for instance b88e66f6-9d59-4ef9-9bac-bf94a99d35fc
Nov 03 14:31:50 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c489b2b0-71cb-44d2-bcc5-1dee396b799b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "b88e66f6-9d59-4ef9-9bac-bf94a99d35fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.291s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:31:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:31:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:01 user nova-compute[74582]: INFO nova.compute.manager [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Terminating instance
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.compute.manager [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-bff05a9c-a8d2-4908-8b72-309c402691e3 req-64c69d78-f65d-4810-a001-0c30f9a34445 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bff05a9c-a8d2-4908-8b72-309c402691e3 req-64c69d78-f65d-4810-a001-0c30f9a34445 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bff05a9c-a8d2-4908-8b72-309c402691e3 req-64c69d78-f65d-4810-a001-0c30f9a34445 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-bff05a9c-a8d2-4908-8b72-309c402691e3 req-64c69d78-f65d-4810-a001-0c30f9a34445 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-bff05a9c-a8d2-4908-8b72-309c402691e3 req-64c69d78-f65d-4810-a001-0c30f9a34445 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-bff05a9c-a8d2-4908-8b72-309c402691e3 req-64c69d78-f65d-4810-a001-0c30f9a34445 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-unplugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:32:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Instance destroyed successfully.
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.objects.instance [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lazy-loading 'resources' on Instance uuid 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1500254791',display_name='tempest-ServerRescueNegativeTestJSON-server-1500254791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1500254791',id=41,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3f5290550c487fa7c35f987312a79b',ramdisk_id='',reservation_id='r-4hil07kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1868952631',owner_user_name='tempest-ServerRescueNegativeTestJSON-1868952631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:21:14Z,user_data=None,user_id='86cb25ef9de143a5a55d341a089e19de',uuid=689c409d-9f60-4ad1-b9c1-5386c7a1bf8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converting VIF {"id": "499a267b-a845-4b95-8cbd-f6e718a553d6", "address": "fa:16:3e:0d:35:54", "network": {"id": "2e9fcfcb-7613-4177-948f-6b12feb50dac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958401224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3f5290550c487fa7c35f987312a79b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a267b-a8", "ovs_interfaceid": "499a267b-a845-4b95-8cbd-f6e718a553d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG os_vif [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap499a267b-a8, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fee5e657-6fce-4efb-bc38-702658b054b8) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:01 user nova-compute[74582]: INFO os_vif [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:35:54,bridge_name='br-int',has_traffic_filtering=True,id=499a267b-a845-4b95-8cbd-f6e718a553d6,network=Network(2e9fcfcb-7613-4177-948f-6b12feb50dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a267b-a8')
Nov 03 14:32:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Deleting instance files /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e_del
Nov 03 14:32:01 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Deletion of /opt/stack/data/nova/instances/689c409d-9f60-4ad1-b9c1-5386c7a1bf8e_del complete
Nov 03 14:32:01 user nova-compute[74582]: INFO nova.compute.manager [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Took 0.63 seconds to destroy the instance on the hypervisor.
Nov 03 14:32:01 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:32:01 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:32:02 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Took 0.39 seconds to deallocate network for instance.
Nov 03 14:32:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-a2268215-e265-4693-8d56-f76899978e74 req-28273124-f234-44a8-bd90-c76f6d29e025 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-deleted-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:32:02 user nova-compute[74582]: INFO nova.compute.manager [req-a2268215-e265-4693-8d56-f76899978e74 req-28273124-f234-44a8-bd90-c76f6d29e025 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Neutron deleted interface 499a267b-a845-4b95-8cbd-f6e718a553d6; detaching it from the instance and deleting it from the info cache
Nov 03 14:32:02 user nova-compute[74582]: DEBUG nova.network.neutron [req-a2268215-e265-4693-8d56-f76899978e74 req-28273124-f234-44a8-bd90-c76f6d29e025 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG nova.compute.manager [req-a2268215-e265-4693-8d56-f76899978e74 req-28273124-f234-44a8-bd90-c76f6d29e025 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Detach interface failed, port_id=499a267b-a845-4b95-8cbd-f6e718a553d6, reason: Instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:32:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:02 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Deleted allocations for instance 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e
Nov 03 14:32:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-a8ef2021-837d-4914-a761-777342c13eab tempest-ServerRescueNegativeTestJSON-1868952631 tempest-ServerRescueNegativeTestJSON-1868952631-project-member] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.342s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-b0642571-f0b8-4af4-a966-6b11b5dd69d9 req-7b61ae21-25c3-40a2-980a-7fc1d63879b9 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:32:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b0642571-f0b8-4af4-a966-6b11b5dd69d9 req-7b61ae21-25c3-40a2-980a-7fc1d63879b9 service nova] Acquiring lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b0642571-f0b8-4af4-a966-6b11b5dd69d9 req-7b61ae21-25c3-40a2-980a-7fc1d63879b9 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:03 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-b0642571-f0b8-4af4-a966-6b11b5dd69d9 req-7b61ae21-25c3-40a2-980a-7fc1d63879b9 service nova] Lock "689c409d-9f60-4ad1-b9c1-5386c7a1bf8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:03 user nova-compute[74582]: DEBUG nova.compute.manager [req-b0642571-f0b8-4af4-a966-6b11b5dd69d9 req-7b61ae21-25c3-40a2-980a-7fc1d63879b9 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] No waiting events found dispatching network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:32:03 user nova-compute[74582]: WARNING nova.compute.manager [req-b0642571-f0b8-4af4-a966-6b11b5dd69d9 req-7b61ae21-25c3-40a2-980a-7fc1d63879b9 service nova] [instance: 689c409d-9f60-4ad1-b9c1-5386c7a1bf8e] Received unexpected event network-vif-plugged-499a267b-a845-4b95-8cbd-f6e718a553d6 for instance with vm_state deleted and task_state None.
Nov 03 14:32:06 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:11 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:21 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:21 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:32:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:31 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:36 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74582) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 14:32:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:32:39 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.06645965576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:32:39 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:32:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:32:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:32:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:32:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 14:32:41 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:46 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:51 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:54 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:56 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-changed-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Refreshing instance network info cache due to event network-changed-030ab83d-a107-4f9a-a3ae-a99f77d10a83. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] Acquiring lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] Acquired lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Refreshing network info cache for port 030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:32:59 user nova-compute[74582]: INFO nova.compute.manager [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Terminating instance
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.compute.manager [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updated VIF entry in instance network info cache for port 030ab83d-a107-4f9a-a3ae-a99f77d10a83. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.network.neutron [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [{"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-813ed384-6c6e-4d83-84a3-25416faa3527 req-e2bfff4d-d516-4e5e-a17a-138f21789532 service nova] Releasing lock "refresh_cache-66979d44-fe4c-45e6-b642-dc45bfa6adcb" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:32:59 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Instance destroyed successfully.
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.objects.instance [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lazy-loading 'resources' on Instance uuid 66979d44-fe4c-45e6-b642-dc45bfa6adcb {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-979050074',display_name='tempest-TestVolumeBootPattern-server-979050074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-979050074',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9sIZgaUm6vXzoM8dP1DIdTlsFJqfF71hnkjoVeFJFJ/JjQV9osClCIu5uzOoCar3Vovj9r15d7O+Oq/5uqxiQ4kjm9o0jP8cHCn3+zgVM1LikV2X/2P4I9rrywPbE+Vw==',key_name='tempest-TestVolumeBootPattern-1485867883',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='333545c5c61843ac89215bcc49b520e3',ramdisk_id='',reservation_id='r-f94o93mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1092687553',owner_user_name='tempest-TestVolumeBootPattern-1092687553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:28:08Z,user_data=None,user_id='c726e17f780a483b8b3a220dfc34125d',uuid=66979d44-fe4c-45e6-b642-dc45bfa6adcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converting VIF {"id": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "address": "fa:16:3e:93:f3:1a", "network": {"id": "3d99a944-a9dd-4336-8498-16fad6584122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1298506736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "333545c5c61843ac89215bcc49b520e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030ab83d-a1", "ovs_interfaceid": "030ab83d-a107-4f9a-a3ae-a99f77d10a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_vif [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap030ab83d-a1, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01a64918-7a24-4d2c-a848-7f7ba2535c0d) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:32:59 user nova-compute[74582]: INFO os_vif [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f3:1a,bridge_name='br-int',has_traffic_filtering=True,id=030ab83d-a107-4f9a-a3ae-a99f77d10a83,network=Network(3d99a944-a9dd-4336-8498-16fad6584122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030ab83d-a1')
Nov 03 14:32:59 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVMNRgaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:32:59 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[418af7af-903f-47a3-a614-68f4eb91fbc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:32:59 user nova-compute[74582]: No targets found.
Nov 03 14:32:59 user nova-compute[74582]: iSNS:
Nov 03 14:32:59 user nova-compute[74582]: No targets found.
Nov 03 14:32:59 user nova-compute[74582]: STATIC:
Nov 03 14:32:59 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b
Nov 03 14:32:59 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:32:59 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:32:59 user nova-compute[74582]: FIRMWARE:
Nov 03 14:32:59 user nova-compute[74582]: No targets found.
Nov 03 14:32:59 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:32:59 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:32:59 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:32:59 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991c17d-5eff-416b-bd62-ab34cdeadaa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f9dbc-13df-4510-a07a-08566ad40502]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:33:00 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b (non-flash)
Nov 03 14:33:00 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f6830bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e6d6b7-7fbf-4c86-bc9e-e4afa5522fc2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5aacfe-1e9f-4176-9928-c9ce8ab9e4ff]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1025ddf9-e5c3-41a5-b3e4-2ec0ff51ec2e]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c8fbe4-5291-4163-bffa-7db3c46cb300]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4c6ebdb5', '/dev/disk/by-id/scsi-1SCST_BIO4c6ebdb5-9e1c4147810b5ea9', '/dev/disk/by-id/scsi-23965316334313437') {{(pid=85690) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4cc874-b450-4ba6-813c-d18dd08887ae]: (4, None) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139a88f-e3b0-427b-b765-4d7518eb1281]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e63a6-f013-4f7b-95f8-5416f9497444]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260]
Nov 03 14:33:00 user nova-compute[74582]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b, portal: 172.16.0.220,3260] successful.
Nov 03 14:33:00 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f67f1712-cfb0-4ed5-8af6-d6bdece05f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe76839f-79aa-4420-a1fa-c57353d539bc]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] <== disconnect_volume: return (303ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:33:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Deleting instance files /opt/stack/data/nova/instances/66979d44-fe4c-45e6-b642-dc45bfa6adcb_del
Nov 03 14:33:00 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Deletion of /opt/stack/data/nova/instances/66979d44-fe4c-45e6-b642-dc45bfa6adcb_del complete
Nov 03 14:33:00 user nova-compute[74582]: INFO nova.compute.manager [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 03 14:33:00 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:33:00 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:33:01 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Took 0.76 seconds to deallocate network for instance.
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-vif-unplugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] No waiting events found dispatching network-vif-unplugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-vif-unplugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] Acquiring lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] No waiting events found dispatching network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:33:01 user nova-compute[74582]: WARNING nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received unexpected event network-vif-plugged-030ab83d-a107-4f9a-a3ae-a99f77d10a83 for instance with vm_state active and task_state deleting.
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Received event network-vif-deleted-030ab83d-a107-4f9a-a3ae-a99f77d10a83 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:33:01 user nova-compute[74582]: INFO nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Neutron deleted interface 030ab83d-a107-4f9a-a3ae-a99f77d10a83; detaching it from the instance and deleting it from the info cache
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.network.neutron [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:33:01 user nova-compute[74582]: DEBUG nova.compute.manager [req-4f70b06c-ca49-495e-8d8e-cfc18eba41c5 req-ba448d17-91ac-438e-8ec6-442af8e802c6 service nova] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Detach interface failed, port_id=030ab83d-a107-4f9a-a3ae-a99f77d10a83, reason: Instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb could not be found. {{(pid=74582) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 14:33:01 user nova-compute[74582]: INFO nova.compute.manager [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] [instance: 66979d44-fe4c-45e6-b642-dc45bfa6adcb] Took 0.84 seconds to detach 1 volumes for instance.
Nov 03 14:33:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:02 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:33:02 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:33:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:02 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Deleted allocations for instance 66979d44-fe4c-45e6-b642-dc45bfa6adcb
Nov 03 14:33:02 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-03e385fd-a92a-4410-91bd-91d3d2cb354b tempest-TestVolumeBootPattern-1092687553 tempest-TestVolumeBootPattern-1092687553-project-member] Lock "66979d44-fe4c-45e6-b642-dc45bfa6adcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:04 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:33:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:33:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:33:09 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:14 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:33:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 1 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:33:14 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance has had 4 of 5 cleanup attempts {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 03 14:33:14 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Deletion of /opt/stack/data/nova/instances/339e891c-da3f-46a3-8303-0d88bb770627_resize failed
Nov 03 14:33:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:19 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:22 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:22 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:33:23 user nova-compute[74582]: INFO nova.compute.claims [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Claim successful on node user
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:33:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.policy [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25680925fedb4a0482eeefbaf78733f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c1eeb4c38494a90866a04a0c55baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:33:23 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Creating image(s)
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "/opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "/opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "/opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk 1073741824" returned: 0 in 0.049s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:23 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.169s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Successfully created port: 1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Cannot resize image /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Ensure instance console log exists: /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Successfully updated port: 1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquired lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-changed-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.compute.manager [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Refreshing instance network info cache due to event network-changed-1810b888-9ce3-48db-bdea-bb74f4cfa583. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] Acquiring lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.network.neutron [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updating instance_info_cache with network_info: [{"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Releasing lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Instance network_info: |[{"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] Acquired lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:33:24 user nova-compute[74582]: DEBUG nova.network.neutron [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Refreshing network info cache for port 1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Start _get_guest_xml network_info=[{"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:33:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:33:25 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1090878660',display_name='tempest-VolumesNegativeTest-instance-1090878660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1090878660',id=51,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c1eeb4c38494a90866a04a0c55baf',ramdisk_id='',reservation_id='r-g634zsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-856583154',owner_user_name='tempest-VolumesNegativeTest-856583154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:33:23Z,user_data=None,user_id='25680925fedb4a0482eeefbaf78733f6',uuid=5076e2af-1112-41a4-99f1-f4008cc66dbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Converting VIF {"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.objects.instance [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lazy-loading 'pci_devices' on Instance uuid 5076e2af-1112-41a4-99f1-f4008cc66dbd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:33:25 user nova-compute[74582]:   <uuid>5076e2af-1112-41a4-99f1-f4008cc66dbd</uuid>
Nov 03 14:33:25 user nova-compute[74582]:   <name>instance-00000033</name>
Nov 03 14:33:25 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:33:25 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:33:25 user nova-compute[74582]:   <metadata>
Nov 03 14:33:25 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:33:25 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:33:25 user nova-compute[74582]:       <nova:name>tempest-VolumesNegativeTest-instance-1090878660</nova:name>
Nov 03 14:33:25 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:33:25</nova:creationTime>
Nov 03 14:33:25 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:33:25 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:33:25 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:33:25 user nova-compute[74582]:       <nova:owner>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:user uuid="25680925fedb4a0482eeefbaf78733f6">tempest-VolumesNegativeTest-856583154-project-member</nova:user>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:project uuid="4f6c1eeb4c38494a90866a04a0c55baf">tempest-VolumesNegativeTest-856583154</nova:project>
Nov 03 14:33:25 user nova-compute[74582]:       </nova:owner>
Nov 03 14:33:25 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:33:25 user nova-compute[74582]:       <nova:ports>
Nov 03 14:33:25 user nova-compute[74582]:         <nova:port uuid="1810b888-9ce3-48db-bdea-bb74f4cfa583">
Nov 03 14:33:25 user nova-compute[74582]:           <nova:ip type="fixed" address="192.168.233.79" ipVersion="4"/>
Nov 03 14:33:25 user nova-compute[74582]:         </nova:port>
Nov 03 14:33:25 user nova-compute[74582]:       </nova:ports>
Nov 03 14:33:25 user nova-compute[74582]:     </nova:instance>
Nov 03 14:33:25 user nova-compute[74582]:   </metadata>
Nov 03 14:33:25 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:33:25 user nova-compute[74582]:     <system>
Nov 03 14:33:25 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:33:25 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:33:25 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:33:25 user nova-compute[74582]:       <entry name="serial">5076e2af-1112-41a4-99f1-f4008cc66dbd</entry>
Nov 03 14:33:25 user nova-compute[74582]:       <entry name="uuid">5076e2af-1112-41a4-99f1-f4008cc66dbd</entry>
Nov 03 14:33:25 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:33:25 user nova-compute[74582]:     </system>
Nov 03 14:33:25 user nova-compute[74582]:   </sysinfo>
Nov 03 14:33:25 user nova-compute[74582]:   <os>
Nov 03 14:33:25 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:33:25 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:33:25 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:33:25 user nova-compute[74582]:   </os>
Nov 03 14:33:25 user nova-compute[74582]:   <features>
Nov 03 14:33:25 user nova-compute[74582]:     <acpi/>
Nov 03 14:33:25 user nova-compute[74582]:     <apic/>
Nov 03 14:33:25 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:33:25 user nova-compute[74582]:   </features>
Nov 03 14:33:25 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:33:25 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:33:25 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:33:25 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:33:25 user nova-compute[74582]:   </clock>
Nov 03 14:33:25 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:33:25 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:33:25 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:33:25 user nova-compute[74582]:   </cpu>
Nov 03 14:33:25 user nova-compute[74582]:   <devices>
Nov 03 14:33:25 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:33:25 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:33:25 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk"/>
Nov 03 14:33:25 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:33:25 user nova-compute[74582]:     </disk>
Nov 03 14:33:25 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:33:25 user nova-compute[74582]:       <mac address="fa:16:3e:bf:f0:4a"/>
Nov 03 14:33:25 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:33:25 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:33:25 user nova-compute[74582]:       <target dev="tap1810b888-9c"/>
Nov 03 14:33:25 user nova-compute[74582]:     </interface>
Nov 03 14:33:25 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:33:25 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/console.log" append="off"/>
Nov 03 14:33:25 user nova-compute[74582]:     </serial>
Nov 03 14:33:25 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:33:25 user nova-compute[74582]:     <video>
Nov 03 14:33:25 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:33:25 user nova-compute[74582]:     </video>
Nov 03 14:33:25 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:33:25 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:33:25 user nova-compute[74582]:     </rng>
Nov 03 14:33:25 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:33:25 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:33:25 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:33:25 user nova-compute[74582]:     </memballoon>
Nov 03 14:33:25 user nova-compute[74582]:   </devices>
Nov 03 14:33:25 user nova-compute[74582]: </domain>
Nov 03 14:33:25 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1090878660',display_name='tempest-VolumesNegativeTest-instance-1090878660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1090878660',id=51,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c1eeb4c38494a90866a04a0c55baf',ramdisk_id='',reservation_id='r-g634zsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-856583154',owner_user_name='tempest-VolumesNegativeTest-856583154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:33:23Z,user_data=None,user_id='25680925fedb4a0482eeefbaf78733f6',uuid=5076e2af-1112-41a4-99f1-f4008cc66dbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Converting VIF {"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG os_vif [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e369eddc-73c1-5be1-849a-6fc9fc7e62dd', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1810b888-9c, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1810b888-9c, col_values=(('qos', UUID('b54584fe-3e83-471c-9604-45a4e9971522')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1810b888-9c, col_values=(('external_ids', {'iface-id': '1810b888-9ce3-48db-bdea-bb74f4cfa583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:f0:4a', 'vm-uuid': '5076e2af-1112-41a4-99f1-f4008cc66dbd'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:25 user nova-compute[74582]: INFO os_vif [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c')
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] No VIF found with MAC fa:16:3e:bf:f0:4a, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updated VIF entry in instance network info cache for port 1810b888-9ce3-48db-bdea-bb74f4cfa583. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG nova.network.neutron [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updating instance_info_cache with network_info: [{"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:33:25 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-7ed279a5-d404-41dc-a5e2-7b6a4c9739ea req-69d44817-5af3-4adf-8bc2-aac6ab73c1e7 service nova] Releasing lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-e9298fb5-3de5-48e9-8576-41d580d41754 req-3907de2d-84a6-43c7-bad2-cd879f9fb186 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e9298fb5-3de5-48e9-8576-41d580d41754 req-3907de2d-84a6-43c7-bad2-cd879f9fb186 service nova] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e9298fb5-3de5-48e9-8576-41d580d41754 req-3907de2d-84a6-43c7-bad2-cd879f9fb186 service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-e9298fb5-3de5-48e9-8576-41d580d41754 req-3907de2d-84a6-43c7-bad2-cd879f9fb186 service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:26 user nova-compute[74582]: DEBUG nova.compute.manager [req-e9298fb5-3de5-48e9-8576-41d580d41754 req-3907de2d-84a6-43c7-bad2-cd879f9fb186 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] No waiting events found dispatching network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:33:26 user nova-compute[74582]: WARNING nova.compute.manager [req-e9298fb5-3de5-48e9-8576-41d580d41754 req-3907de2d-84a6-43c7-bad2-cd879f9fb186 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received unexpected event network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 for instance with vm_state building and task_state spawning.
Nov 03 14:33:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:33:28 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Instance spawned successfully.
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:33:28 user nova-compute[74582]: INFO nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:33:28 user nova-compute[74582]: INFO nova.compute.manager [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Took 5.69 seconds to build instance.
Nov 03 14:33:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bd16768f-780f-4fa1-a64c-a9f67b7c6030 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.785s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-1d202466-e9ae-472a-b444-fc3227b837f9 req-4db3eccb-1fbd-4916-aa98-071fc276af56 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1d202466-e9ae-472a-b444-fc3227b837f9 req-4db3eccb-1fbd-4916-aa98-071fc276af56 service nova] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1d202466-e9ae-472a-b444-fc3227b837f9 req-4db3eccb-1fbd-4916-aa98-071fc276af56 service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-1d202466-e9ae-472a-b444-fc3227b837f9 req-4db3eccb-1fbd-4916-aa98-071fc276af56 service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:28 user nova-compute[74582]: DEBUG nova.compute.manager [req-1d202466-e9ae-472a-b444-fc3227b837f9 req-4db3eccb-1fbd-4916-aa98-071fc276af56 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] No waiting events found dispatching network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:33:28 user nova-compute[74582]: WARNING nova.compute.manager [req-1d202466-e9ae-472a-b444-fc3227b837f9 req-4db3eccb-1fbd-4916-aa98-071fc276af56 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received unexpected event network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 for instance with vm_state active and task_state None.
Nov 03 14:33:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:33 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:35 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:35 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:36 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:33:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:33:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:33:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:33:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.055828094482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 5076e2af-1112-41a4-99f1-f4008cc66dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:33:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:33:42 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 5076e2af-1112-41a4-99f1-f4008cc66dbd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:33:43 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updating instance_info_cache with network_info: [{"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:33:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:33:43 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:33:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:33:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:33:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:33:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:33:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:52 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:33:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:15 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:16 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:24 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:25 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:26 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:34:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:34:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:32 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Triggering sync for uuid 5076e2af-1112-41a4-99f1-f4008cc66dbd {{(pid=74582) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 14:34:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:34:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:34:32 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:34:35 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:35 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:37 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:34:40 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:34:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:34:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.026351928710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance 5076e2af-1112-41a4-99f1-f4008cc66dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:34:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid 5076e2af-1112-41a4-99f1-f4008cc66dbd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updating instance_info_cache with network_info: [{"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-5076e2af-1112-41a4-99f1-f4008cc66dbd" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:34:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:34:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:34:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:45 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:34:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:34:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:34:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:34:55 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:00 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:05 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:35:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:10 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:13 user nova-compute[74582]: INFO nova.compute.manager [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Terminating instance
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.compute.manager [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-3da32dd6-0dac-498d-a564-46eab57407ac req-b20f9912-b579-4e65-9ec7-5b96ce6fbbd2 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-vif-unplugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3da32dd6-0dac-498d-a564-46eab57407ac req-b20f9912-b579-4e65-9ec7-5b96ce6fbbd2 service nova] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3da32dd6-0dac-498d-a564-46eab57407ac req-b20f9912-b579-4e65-9ec7-5b96ce6fbbd2 service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3da32dd6-0dac-498d-a564-46eab57407ac req-b20f9912-b579-4e65-9ec7-5b96ce6fbbd2 service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-3da32dd6-0dac-498d-a564-46eab57407ac req-b20f9912-b579-4e65-9ec7-5b96ce6fbbd2 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] No waiting events found dispatching network-vif-unplugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.compute.manager [req-3da32dd6-0dac-498d-a564-46eab57407ac req-b20f9912-b579-4e65-9ec7-5b96ce6fbbd2 service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-vif-unplugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:35:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Instance destroyed successfully.
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.objects.instance [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lazy-loading 'resources' on Instance uuid 5076e2af-1112-41a4-99f1-f4008cc66dbd {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1090878660',display_name='tempest-VolumesNegativeTest-instance-1090878660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1090878660',id=51,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c1eeb4c38494a90866a04a0c55baf',ramdisk_id='',reservation_id='r-g634zsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-856583154',owner_user_name='tempest-VolumesNegativeTest-856583154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:33:29Z,user_data=None,user_id='25680925fedb4a0482eeefbaf78733f6',uuid=5076e2af-1112-41a4-99f1-f4008cc66dbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Converting VIF {"id": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "address": "fa:16:3e:bf:f0:4a", "network": {"id": "3a311ce5-0381-468e-abb2-831f712e9418", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d7306610e03543b3872bf84fcc9490e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1810b888-9c", "ovs_interfaceid": "1810b888-9ce3-48db-bdea-bb74f4cfa583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG os_vif [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1810b888-9c, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b54584fe-3e83-471c-9604-45a4e9971522) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:13 user nova-compute[74582]: INFO os_vif [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f0:4a,bridge_name='br-int',has_traffic_filtering=True,id=1810b888-9ce3-48db-bdea-bb74f4cfa583,network=Network(3a311ce5-0381-468e-abb2-831f712e9418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1810b888-9c')
Nov 03 14:35:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Deleting instance files /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd_del
Nov 03 14:35:13 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Deletion of /opt/stack/data/nova/instances/5076e2af-1112-41a4-99f1-f4008cc66dbd_del complete
Nov 03 14:35:13 user nova-compute[74582]: INFO nova.compute.manager [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 03 14:35:13 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:35:13 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:35:14 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:14 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:35:14 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Took 0.43 seconds to deallocate network for instance.
Nov 03 14:35:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:14 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:35:14 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:35:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:14 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Deleted allocations for instance 5076e2af-1112-41a4-99f1-f4008cc66dbd
Nov 03 14:35:14 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-c390edd0-2da9-415b-953b-2ed703c7c6a2 tempest-VolumesNegativeTest-856583154 tempest-VolumesNegativeTest-856583154-project-member] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:35:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] Acquiring lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:15 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] Lock "5076e2af-1112-41a4-99f1-f4008cc66dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] No waiting events found dispatching network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:35:15 user nova-compute[74582]: WARNING nova.compute.manager [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received unexpected event network-vif-plugged-1810b888-9ce3-48db-bdea-bb74f4cfa583 for instance with vm_state deleted and task_state None.
Nov 03 14:35:15 user nova-compute[74582]: DEBUG nova.compute.manager [req-3551cca5-5701-4dc5-bbc9-a350da404165 req-6f76d2cb-b305-47b2-8cd2-ab2f66cbed0d service nova] [instance: 5076e2af-1112-41a4-99f1-f4008cc66dbd] Received event network-vif-deleted-1810b888-9ce3-48db-bdea-bb74f4cfa583 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:35:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:35:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:26 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:36 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:35:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:35:41 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=9098MB free_disk=25.05307388305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:35:41 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:35:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:35:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:35:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:35:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 14:35:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:35:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:35:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:35:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:35:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:36:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:36:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:36:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:36:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:36:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:36:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:20 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:24 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:26 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:36:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:30 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Starting instance... {{(pid=74582) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74582) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 14:36:36 user nova-compute[74582]: INFO nova.compute.claims [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Claim successful on node user
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Start building networks asynchronously for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Allocating IP information in the background. {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] allocate_for_instance() {{(pid=74582) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 14:36:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Start building block device mappings for instance. {{(pid=74582) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.policy [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e796430534e9477f94c0387299acc9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a8d02a43c54684bc38e026995fc962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74582) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Start spawning the instance on the hypervisor. {{(pid=74582) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Creating instance directory {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 14:36:36 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Creating image(s)
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "/opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "/opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:36 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.176s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.208s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk 1073741824 {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001,backing_fmt=raw /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk 1073741824" returned: 0 in 0.064s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "9ae3a8a2a961ee50bfba42d45da28a9848c14001" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Successfully created port: 892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ae3a8a2a961ee50bfba42d45da28a9848c14001 --force-share --output=json" returned: 0 in 0.226s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk. size=1073741824 {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG nova.virt.disk.api [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Cannot resize image /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk to a smaller size. {{(pid=74582) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Created local disks {{(pid=74582) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Ensure instance console log exists: /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/console.log {{(pid=74582) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:37 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Successfully updated port: 892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Building network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-changed-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.compute.manager [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Refreshing instance network info cache due to event network-changed-892b5c2d-541e-4218-898c-ba9f665cb8a5. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Instance cache missing network info. {{(pid=74582) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.neutron [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Instance network_info: |[{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74582) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.neutron [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Refreshing network info cache for port 892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Start _get_guest_xml network_info=[{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': 'd1bad2f4-1913-4064-b654-ebb096d97d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 14:36:38 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:36:38 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CPU controller missing on host. {{(pid=74582) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.host [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CPU controller found on host. {{(pid=74582) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74582) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T13:42:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T13:43:14Z,direct_url=<?>,disk_format='qcow2',id=d1bad2f4-1913-4064-b654-ebb096d97d3b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d7306610e03543b3872bf84fcc9490e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T13:43:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Flavor limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Image limits 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Flavor pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Image pref 0:0:0 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Got 1 possible topologies {{(pid=74582) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.hardware [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74582) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3653325',id=52,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIJPdgqz8a3AegXphZFQLDI48UEkuCixFjGami6ilTysmTOOdNk9A6zRi4133u282c36NZMT6l3N1TLwPgE7yRGncHq7HhB4kq78llZrCNyBwhodCIg0EOEi/T35vB9Pg==',key_name='tempest-keypair-1985548692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78a8d02a43c54684bc38e026995fc962',ramdisk_id='',reservation_id='r-3h4vynbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2063208117',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:36:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e796430534e9477f94c0387299acc9ae',uuid=d3ee0b38-49cf-4df6-bbca-0a74262555d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74582) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Converting VIF {"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.objects.instance [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] End _get_guest_xml xml=<domain type="kvm">
Nov 03 14:36:38 user nova-compute[74582]:   <uuid>d3ee0b38-49cf-4df6-bbca-0a74262555d4</uuid>
Nov 03 14:36:38 user nova-compute[74582]:   <name>instance-00000034</name>
Nov 03 14:36:38 user nova-compute[74582]:   <memory>524288</memory>
Nov 03 14:36:38 user nova-compute[74582]:   <vcpu>1</vcpu>
Nov 03 14:36:38 user nova-compute[74582]:   <metadata>
Nov 03 14:36:38 user nova-compute[74582]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 14:36:38 user nova-compute[74582]:       <nova:package version="0.0.0"/>
Nov 03 14:36:38 user nova-compute[74582]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566</nova:name>
Nov 03 14:36:38 user nova-compute[74582]:       <nova:creationTime>2023-11-03 14:36:38</nova:creationTime>
Nov 03 14:36:38 user nova-compute[74582]:       <nova:flavor name="m1.tiny">
Nov 03 14:36:38 user nova-compute[74582]:         <nova:memory>512</nova:memory>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:disk>1</nova:disk>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:swap>0</nova:swap>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:vcpus>1</nova:vcpus>
Nov 03 14:36:38 user nova-compute[74582]:       </nova:flavor>
Nov 03 14:36:38 user nova-compute[74582]:       <nova:owner>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:user uuid="e796430534e9477f94c0387299acc9ae">tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member</nova:user>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:project uuid="78a8d02a43c54684bc38e026995fc962">tempest-TestServerVolumeAttachScenarioOldVersion-2063208117</nova:project>
Nov 03 14:36:38 user nova-compute[74582]:       </nova:owner>
Nov 03 14:36:38 user nova-compute[74582]:       <nova:root type="image" uuid="d1bad2f4-1913-4064-b654-ebb096d97d3b"/>
Nov 03 14:36:38 user nova-compute[74582]:       <nova:ports>
Nov 03 14:36:38 user nova-compute[74582]:         <nova:port uuid="892b5c2d-541e-4218-898c-ba9f665cb8a5">
Nov 03 14:36:38 user nova-compute[74582]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 14:36:38 user nova-compute[74582]:         </nova:port>
Nov 03 14:36:38 user nova-compute[74582]:       </nova:ports>
Nov 03 14:36:38 user nova-compute[74582]:     </nova:instance>
Nov 03 14:36:38 user nova-compute[74582]:   </metadata>
Nov 03 14:36:38 user nova-compute[74582]:   <sysinfo type="smbios">
Nov 03 14:36:38 user nova-compute[74582]:     <system>
Nov 03 14:36:38 user nova-compute[74582]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 14:36:38 user nova-compute[74582]:       <entry name="product">OpenStack Nova</entry>
Nov 03 14:36:38 user nova-compute[74582]:       <entry name="version">0.0.0</entry>
Nov 03 14:36:38 user nova-compute[74582]:       <entry name="serial">d3ee0b38-49cf-4df6-bbca-0a74262555d4</entry>
Nov 03 14:36:38 user nova-compute[74582]:       <entry name="uuid">d3ee0b38-49cf-4df6-bbca-0a74262555d4</entry>
Nov 03 14:36:38 user nova-compute[74582]:       <entry name="family">Virtual Machine</entry>
Nov 03 14:36:38 user nova-compute[74582]:     </system>
Nov 03 14:36:38 user nova-compute[74582]:   </sysinfo>
Nov 03 14:36:38 user nova-compute[74582]:   <os>
Nov 03 14:36:38 user nova-compute[74582]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 14:36:38 user nova-compute[74582]:     <boot dev="hd"/>
Nov 03 14:36:38 user nova-compute[74582]:     <smbios mode="sysinfo"/>
Nov 03 14:36:38 user nova-compute[74582]:   </os>
Nov 03 14:36:38 user nova-compute[74582]:   <features>
Nov 03 14:36:38 user nova-compute[74582]:     <acpi/>
Nov 03 14:36:38 user nova-compute[74582]:     <apic/>
Nov 03 14:36:38 user nova-compute[74582]:     <vmcoreinfo/>
Nov 03 14:36:38 user nova-compute[74582]:   </features>
Nov 03 14:36:38 user nova-compute[74582]:   <clock offset="utc">
Nov 03 14:36:38 user nova-compute[74582]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 14:36:38 user nova-compute[74582]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 14:36:38 user nova-compute[74582]:     <timer name="hpet" present="no"/>
Nov 03 14:36:38 user nova-compute[74582]:   </clock>
Nov 03 14:36:38 user nova-compute[74582]:   <cpu mode="custom" match="exact">
Nov 03 14:36:38 user nova-compute[74582]:     <model>Nehalem</model>
Nov 03 14:36:38 user nova-compute[74582]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 14:36:38 user nova-compute[74582]:   </cpu>
Nov 03 14:36:38 user nova-compute[74582]:   <devices>
Nov 03 14:36:38 user nova-compute[74582]:     <disk type="file" device="disk">
Nov 03 14:36:38 user nova-compute[74582]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 14:36:38 user nova-compute[74582]:       <source file="/opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk"/>
Nov 03 14:36:38 user nova-compute[74582]:       <target dev="vda" bus="virtio"/>
Nov 03 14:36:38 user nova-compute[74582]:     </disk>
Nov 03 14:36:38 user nova-compute[74582]:     <interface type="ethernet">
Nov 03 14:36:38 user nova-compute[74582]:       <mac address="fa:16:3e:c2:12:8f"/>
Nov 03 14:36:38 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:36:38 user nova-compute[74582]:       <mtu size="1442"/>
Nov 03 14:36:38 user nova-compute[74582]:       <target dev="tap892b5c2d-54"/>
Nov 03 14:36:38 user nova-compute[74582]:     </interface>
Nov 03 14:36:38 user nova-compute[74582]:     <serial type="pty">
Nov 03 14:36:38 user nova-compute[74582]:       <log file="/opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/console.log" append="off"/>
Nov 03 14:36:38 user nova-compute[74582]:     </serial>
Nov 03 14:36:38 user nova-compute[74582]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 14:36:38 user nova-compute[74582]:     <video>
Nov 03 14:36:38 user nova-compute[74582]:       <model type="virtio"/>
Nov 03 14:36:38 user nova-compute[74582]:     </video>
Nov 03 14:36:38 user nova-compute[74582]:     <rng model="virtio">
Nov 03 14:36:38 user nova-compute[74582]:       <backend model="random">/dev/urandom</backend>
Nov 03 14:36:38 user nova-compute[74582]:     </rng>
Nov 03 14:36:38 user nova-compute[74582]:     <controller type="usb" index="0" model="none"/>
Nov 03 14:36:38 user nova-compute[74582]:     <memballoon model="virtio">
Nov 03 14:36:38 user nova-compute[74582]:       <stats period="10"/>
Nov 03 14:36:38 user nova-compute[74582]:     </memballoon>
Nov 03 14:36:38 user nova-compute[74582]:   </devices>
Nov 03 14:36:38 user nova-compute[74582]: </domain>
Nov 03 14:36:38 user nova-compute[74582]:  {{(pid=74582) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3653325',id=52,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIJPdgqz8a3AegXphZFQLDI48UEkuCixFjGami6ilTysmTOOdNk9A6zRi4133u282c36NZMT6l3N1TLwPgE7yRGncHq7HhB4kq78llZrCNyBwhodCIg0EOEi/T35vB9Pg==',key_name='tempest-keypair-1985548692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78a8d02a43c54684bc38e026995fc962',ramdisk_id='',reservation_id='r-3h4vynbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2063208117',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T14:36:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e796430534e9477f94c0387299acc9ae',uuid=d3ee0b38-49cf-4df6-bbca-0a74262555d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Converting VIF {"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG os_vif [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54') {{(pid=74582) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa682d7b-40d1-5237-b3f9-1e279c49b804', '_type': 'linux-noop'}}, row=False) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap892b5c2d-54, may_exist=True, interface_attrs={}) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap892b5c2d-54, col_values=(('qos', UUID('77fb0b3a-2057-4ecd-b2a0-b64caf44c302')),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap892b5c2d-54, col_values=(('external_ids', {'iface-id': '892b5c2d-541e-4218-898c-ba9f665cb8a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:12:8f', 'vm-uuid': 'd3ee0b38-49cf-4df6-bbca-0a74262555d4'}),), if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:38 user nova-compute[74582]: INFO os_vif [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54')
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] No VIF found with MAC fa:16:3e:c2:12:8f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.neutron [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updated VIF entry in instance network info cache for port 892b5c2d-541e-4218-898c-ba9f665cb8a5. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG nova.network.neutron [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:36:38 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-f1353e3d-1874-42e7-91aa-66d6dc61847a req-e7a86cba-218f-47d1-b0a7-143b98a731a7 service nova] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:36:39 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:39 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-45810c5a-a2cd-4e80-bcda-1c3c63088629 req-b9e756e0-89ea-4721-98ee-73eee9bd0a4d service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-45810c5a-a2cd-4e80-bcda-1c3c63088629 req-b9e756e0-89ea-4721-98ee-73eee9bd0a4d service nova] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-45810c5a-a2cd-4e80-bcda-1c3c63088629 req-b9e756e0-89ea-4721-98ee-73eee9bd0a4d service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-45810c5a-a2cd-4e80-bcda-1c3c63088629 req-b9e756e0-89ea-4721-98ee-73eee9bd0a4d service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG nova.compute.manager [req-45810c5a-a2cd-4e80-bcda-1c3c63088629 req-b9e756e0-89ea-4721-98ee-73eee9bd0a4d service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] No waiting events found dispatching network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:36:40 user nova-compute[74582]: WARNING nova.compute.manager [req-45810c5a-a2cd-4e80-bcda-1c3c63088629 req-b9e756e0-89ea-4721-98ee-73eee9bd0a4d service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received unexpected event network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 for instance with vm_state building and task_state spawning.
Nov 03 14:36:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:40 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:41 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Instance event wait completed in 0 seconds for  {{(pid=74582) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 14:36:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Guest created on hypervisor {{(pid=74582) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 14:36:41 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Instance spawned successfully.
Nov 03 14:36:41 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Found default for hw_cdrom_bus of ide {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Found default for hw_disk_bus of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Found default for hw_input_bus of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Found default for hw_pointer_model of None {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Found default for hw_video_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Found default for hw_vif_model of virtio {{(pid=74582) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 14:36:42 user nova-compute[74582]: INFO nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Checking state {{(pid=74582) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-601d45bb-575f-46c0-9ad1-450a96510350 req-56f34564-f0b8-4b4e-a809-31080ccbef0a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-601d45bb-575f-46c0-9ad1-450a96510350 req-56f34564-f0b8-4b4e-a809-31080ccbef0a service nova] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-601d45bb-575f-46c0-9ad1-450a96510350 req-56f34564-f0b8-4b4e-a809-31080ccbef0a service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-601d45bb-575f-46c0-9ad1-450a96510350 req-56f34564-f0b8-4b4e-a809-31080ccbef0a service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.compute.manager [req-601d45bb-575f-46c0-9ad1-450a96510350 req-56f34564-f0b8-4b4e-a809-31080ccbef0a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] No waiting events found dispatching network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:36:42 user nova-compute[74582]: WARNING nova.compute.manager [req-601d45bb-575f-46c0-9ad1-450a96510350 req-56f34564-f0b8-4b4e-a809-31080ccbef0a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received unexpected event network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 for instance with vm_state building and task_state spawning.
Nov 03 14:36:42 user nova-compute[74582]: INFO nova.compute.manager [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Took 5.87 seconds to build instance.
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-e51cadb1-7836-4398-a814-b320995901b4 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.003s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:36:42 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:36:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:36:43 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=25.041351318359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:36:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:36:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:36:47 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:36:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:36:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:07 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:12 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:37:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:37:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:37:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:37:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:27 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:37:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:37:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:37:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:37:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:29 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:37:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:37:36 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:37:40 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:37:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:37:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:37:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.01275634765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:37:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:37:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:37:46 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:37:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:37:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:37:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:17 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 14:38:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] There are 1 instances to clean {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 14:38:17 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: 339e891c-da3f-46a3-8303-0d88bb770627] Instance has had 5 of 5 cleanup attempts {{(pid=74582) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 03 14:38:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:38:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:38:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:38:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:38:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:38:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-changed-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG nova.compute.manager [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Refreshing instance network info cache due to event network-changed-892b5c2d-541e-4218-898c-ba9f665cb8a5. {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Refreshing network info cache for port 892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updated VIF entry in instance network info cache for port 892b5c2d-541e-4218-898c-ba9f665cb8a5. {{(pid=74582) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG nova.network.neutron [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:38:27 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-95bbd3b6-ef2d-41bc-9c02-4b536da04631 req-2220f4e3-5c67-462b-86e4-aaec0e74926a service nova] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:38:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:29 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:30 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:38:32 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG nova.objects.instance [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lazy-loading 'flavor' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:38:33 user nova-compute[74582]: INFO nova.compute.manager [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Attaching volume ed886320-3680-4436-8dfe-9542b566c618 to /dev/vdb
Nov 03 14:38:33 user nova-compute[74582]: DEBUG os_brick.utils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c0f6c-5a61-4ec2-92b0-f3284db6aa49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9eed7e5e4524\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab17240-7fe2-4165-8a4b-bf25d6bdf9bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e2e1c1-ea9c-483b-8899-0e6c2115e9b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2b81bd-c113-4aec-bc52-a49ccd1f307e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Running cmd (subprocess): nvme version {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] 'nvme version' failed. Not Retrying. {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] nvme not present on system {{(pid=74582) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 14:38:33 user nova-compute[74582]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 14:38:33 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d385815-d993-4efd-9375-3954e610c5b7]: (4, '') {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74582) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.lightos [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] LIGHTOS: no hostnqn found. {{(pid=74582) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG os_brick.utils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9eed7e5e4524', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:38:33 user nova-compute[74582]: DEBUG nova.virt.block_device [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating existing volume attachment record: c92079f0-b216-4177-9646-65c4a472b1c5 {{(pid=74582) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 14:38:37 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:38 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:41 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:42 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:38:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.01195526123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing inventories for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating ProviderTree inventory for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Updating inventory in ProviderTree for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing aggregate associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, aggregates: None {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Refreshing trait associations for resource provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e, traits: HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB {{(pid=74582) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:44 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74582) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:38:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:38:46 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:38:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:38:46 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:38:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Calling os-brick to attach iSCSI Volume {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aptZMoKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:38:52 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:38:52 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:38:52 user nova-compute[74582]: INFO os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f9a2a-097c-49a1-a4c4-f3c138cd4193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 14:38:52 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --interface default --op new {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e564e0ae-c594-48d5-a272-5863b66e2966]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618] added\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618] added
Nov 03 14:38:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bba96d-9e27-40e9-a217-cb4c01763070]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e65ce12-955e-40ac-82f9-ad47a87ad0eb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aptZMoKI {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aptZMoKI" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfa5546-fc7a-45c5-823b-4506d1c91db0]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aptZMoKI'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce647b6-3d5e-45ac-9eab-a5807a4718c2]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee465160-703a-46d9-95a5-8e5faca9cebe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 14:38:52 user nova-compute[74582]:  {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 14:38:52 user nova-compute[74582]:  {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:38:52 user nova-compute[74582]: WARNING os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 14:38:52 user nova-compute[74582]: 
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --login {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb01d6-2b54-4f3e-b85a-05aeb6f6a5ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260]
Nov 03 14:38:52 user nova-compute[74582]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260] successful.
Nov 03 14:38:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b6e809-b4d5-43b1-b4bd-42c2196a63bb]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c902b83-b6a1-4836-a1bf-24143f1cbbd3]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 (non-flash)
Nov 03 14:38:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 (non-flash)
Nov 03 14:38:52 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Connected to 172.16.0.220:3260 {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74582) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74582) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436f547-611c-44a4-b28b-6aaff9a3a8d0]: (4, ('- - 0', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:38:52 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74582) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aptZMoKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74582) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '23961343531346366', 'path': '/dev/sdb'} {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961343531346366', 'path': '/dev/sdb'} {{(pid=74582) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG nova.objects.instance [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lazy-loading 'flavor' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 14:38:53 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:38:53 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:38:53 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:38:53 user nova-compute[74582]:   <serial>ed886320-3680-4436-8dfe-9542b566c618</serial>
Nov 03 14:38:53 user nova-compute[74582]: </disk>
Nov 03 14:38:53 user nova-compute[74582]:  {{(pid=74582) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74582) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 14:38:53 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] No VIF found with MAC fa:16:3e:c2:12:8f, not building metadata {{(pid=74582) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 14:38:54 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-bf50e66b-ef0b-4090-bbe1-f5bec614eac5 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.443s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:38:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:38:56 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:38:56 user nova-compute[74582]: INFO nova.compute.manager [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Detaching volume ed886320-3680-4436-8dfe-9542b566c618
Nov 03 14:38:56 user nova-compute[74582]: INFO nova.virt.block_device [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Attempting to driver detach volume ed886320-3680-4436-8dfe-9542b566c618 from mountpoint /dev/vdb
Nov 03 14:38:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Attempting to detach device vdb from instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 from the persistent domain config. {{(pid=74582) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 14:38:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:38:56 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:38:56 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:38:56 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:38:56 user nova-compute[74582]:   <serial>ed886320-3680-4436-8dfe-9542b566c618</serial>
Nov 03 14:38:56 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:38:56 user nova-compute[74582]: </disk>
Nov 03 14:38:56 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:38:56 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Successfully detached device vdb from instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 from the persistent domain config.
Nov 03 14:38:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 from the live domain config. {{(pid=74582) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 14:38:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.guest [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 14:38:56 user nova-compute[74582]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 14:38:56 user nova-compute[74582]:   <source dev="/dev/sdb"/>
Nov 03 14:38:56 user nova-compute[74582]:   <target dev="vdb" bus="virtio"/>
Nov 03 14:38:56 user nova-compute[74582]:   <serial>ed886320-3680-4436-8dfe-9542b566c618</serial>
Nov 03 14:38:56 user nova-compute[74582]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 14:38:56 user nova-compute[74582]: </disk>
Nov 03 14:38:56 user nova-compute[74582]:  {{(pid=74582) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 14:38:56 user nova-compute[74582]: DEBUG nova.virt.libvirt.driver [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 14:38:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:02 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:16 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 is timed out.
Nov 03 14:39:16 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Successfully detached device vdb from instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 from the live domain config.
Nov 03 14:39:16 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] calling os-brick to detach iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7f687ba530>, {'target_iqn': 'iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aptZMoKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 14:39:16 user nova-compute[74582]: WARNING os_brick.initiator.connectors.base [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44c1d32-9b98-4033-b0b0-a3a9af16dd3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 14:39:16 user nova-compute[74582]: No targets found.
Nov 03 14:39:16 user nova-compute[74582]: iSNS:
Nov 03 14:39:16 user nova-compute[74582]: No targets found.
Nov 03 14:39:16 user nova-compute[74582]: STATIC:
Nov 03 14:39:16 user nova-compute[74582]: Target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618
Nov 03 14:39:16 user nova-compute[74582]:         Portal: 172.16.0.220:3260,-1
Nov 03 14:39:16 user nova-compute[74582]:                 Iface Name: default
Nov 03 14:39:16 user nova-compute[74582]: FIRMWARE:
Nov 03 14:39:16 user nova-compute[74582]: No targets found.
Nov 03 14:39:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 14:39:16 user nova-compute[74582]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 14:39:16 user nova-compute[74582]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74582) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618', 0)] {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2549ce8-42d6-4923-964b-da88a4f4f497]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a012a-807d-4317-a8a5-04761ff6ee6d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 (non-flash)\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 (non-flash)
Nov 03 14:39:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 (non-flash)
Nov 03 14:39:16 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7f682dc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618'): ({'sdb'}, set())}) {{(pid=74582) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Removing single pathed devices sdb {{(pid=74582) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac3b16-4b49-448c-8e10-812a0c976c37]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3431d8-7eea-46d7-950a-a980ddc48a3e]: (4, ('ok\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Flushing IO for device /dev/sdb {{(pid=74582) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa72040-e5af-4e4a-8965-f809a9845aac]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74582) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1701f0-bcf3-45ce-ba93-16d0521e5621]: (4, ('1', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.linuxscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] SCSI volumes sdb have been removed. {{(pid=74582) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618')] {{(pid=74582) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee06fe91-3e80-4aea-baf1-269a530ae397]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --logout {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:16 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c32aad1-d999-4ee8-ad08-6ba43c94ccfb]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260]
Nov 03 14:39:17 user nova-compute[74582]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618, portal: 172.16.0.220,3260] successful.
Nov 03 14:39:17 user nova-compute[74582]:  stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op delete {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed886320-3680-4436-8dfe-9542b566c618 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b914ee-50df-4d65-ae63-6d244cc82e62]: (4, ('', '')) {{(pid=85690) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74582) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.base [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] <== disconnect_volume: return (293ms) None {{(pid=74582) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Disconnected iSCSI Volume {{(pid=74582) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG nova.objects.instance [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lazy-loading 'flavor' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:39:17 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-ef980d24-a49a-4865-a5fe-bdbe8678828e tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74582) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 14:39:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:39:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74582) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 14:39:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:32 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:39:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:38 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 14:39:43 user nova-compute[74582]: DEBUG oslo_concurrency.processutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74582) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 14:39:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:39:44 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.01103973388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Instance d3ee0b38-49cf-4df6-bbca-0a74262555d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74582) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:39:44 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquired lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Forcefully refreshing network info cache for instance {{(pid=74582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 14:39:45 user nova-compute[74582]: DEBUG nova.objects.instance [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lazy-loading 'info_cache' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:39:46 user nova-compute[74582]: DEBUG nova.network.neutron [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [{"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:39:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Releasing lock "refresh_cache-d3ee0b38-49cf-4df6-bbca-0a74262555d4" {{(pid=74582) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 14:39:46 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updated the network info_cache for instance {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 14:39:48 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:39:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:57 user nova-compute[74582]: INFO nova.compute.manager [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Terminating instance
Nov 03 14:39:57 user nova-compute[74582]: DEBUG nova.compute.manager [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Start destroying the instance on the hypervisor. {{(pid=74582) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-cfef127f-92b7-456b-8b95-244f0469b004 req-6fda4930-de18-4755-89ef-851796610d68 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-vif-unplugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cfef127f-92b7-456b-8b95-244f0469b004 req-6fda4930-de18-4755-89ef-851796610d68 service nova] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cfef127f-92b7-456b-8b95-244f0469b004 req-6fda4930-de18-4755-89ef-851796610d68 service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-cfef127f-92b7-456b-8b95-244f0469b004 req-6fda4930-de18-4755-89ef-851796610d68 service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-cfef127f-92b7-456b-8b95-244f0469b004 req-6fda4930-de18-4755-89ef-851796610d68 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] No waiting events found dispatching network-vif-unplugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG nova.compute.manager [req-cfef127f-92b7-456b-8b95-244f0469b004 req-6fda4930-de18-4755-89ef-851796610d68 service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-vif-unplugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 for instance with task_state deleting. {{(pid=74582) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:57 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Instance destroyed successfully.
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.objects.instance [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lazy-loading 'resources' on Instance uuid d3ee0b38-49cf-4df6-bbca-0a74262555d4 {{(pid=74582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.virt.libvirt.vif [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T14:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-365332566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3653325',id=52,image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIJPdgqz8a3AegXphZFQLDI48UEkuCixFjGami6ilTysmTOOdNk9A6zRi4133u282c36NZMT6l3N1TLwPgE7yRGncHq7HhB4kq78llZrCNyBwhodCIg0EOEi/T35vB9Pg==',key_name='tempest-keypair-1985548692',keypairs=<?>,launch_index=0,launched_at=2023-11-03T14:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78a8d02a43c54684bc38e026995fc962',ramdisk_id='',reservation_id='r-3h4vynbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1bad2f4-1913-4064-b654-ebb096d97d3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2063208117',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T14:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e796430534e9477f94c0387299acc9ae',uuid=d3ee0b38-49cf-4df6-bbca-0a74262555d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Converting VIF {"id": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "address": "fa:16:3e:c2:12:8f", "network": {"id": "e8f93447-e428-4cd4-b508-7827a82e5c67", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2027384598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78a8d02a43c54684bc38e026995fc962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892b5c2d-54", "ovs_interfaceid": "892b5c2d-541e-4218-898c-ba9f665cb8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.network.os_vif_util [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54') {{(pid=74582) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG os_vif [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54') {{(pid=74582) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap892b5c2d-54, bridge=br-int, if_exists=True) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77fb0b3a-2057-4ecd-b2a0-b64caf44c302) {{(pid=74582) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:39:58 user nova-compute[74582]: INFO os_vif [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=892b5c2d-541e-4218-898c-ba9f665cb8a5,network=Network(e8f93447-e428-4cd4-b508-7827a82e5c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892b5c2d-54')
Nov 03 14:39:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Deleting instance files /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4_del
Nov 03 14:39:58 user nova-compute[74582]: INFO nova.virt.libvirt.driver [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Deletion of /opt/stack/data/nova/instances/d3ee0b38-49cf-4df6-bbca-0a74262555d4_del complete
Nov 03 14:39:58 user nova-compute[74582]: INFO nova.compute.manager [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 03 14:39:58 user nova-compute[74582]: DEBUG oslo.service.loopingcall [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74582) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.compute.manager [-] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Deallocating network for instance {{(pid=74582) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] deallocate_for_instance() {{(pid=74582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:39:58 user nova-compute[74582]: DEBUG nova.network.neutron [-] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Updating instance_info_cache with network_info: [] {{(pid=74582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 14:39:59 user nova-compute[74582]: INFO nova.compute.manager [-] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Took 0.86 seconds to deallocate network for instance.
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:59 user nova-compute[74582]: INFO nova.scheduler.client.report [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Deleted allocations for instance d3ee0b38-49cf-4df6-bbca-0a74262555d4
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-cfb2ce6d-b28d-432f-a2fc-1bf5a53160b3 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117 tempest-TestServerVolumeAttachScenarioOldVersion-2063208117-project-member] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] Acquiring lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] Lock "d3ee0b38-49cf-4df6-bbca-0a74262555d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:39:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] No waiting events found dispatching network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 14:39:59 user nova-compute[74582]: WARNING nova.compute.manager [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received unexpected event network-vif-plugged-892b5c2d-541e-4218-898c-ba9f665cb8a5 for instance with vm_state deleted and task_state None.
Nov 03 14:39:59 user nova-compute[74582]: DEBUG nova.compute.manager [req-a524352d-d219-4ce6-a973-c4d7203a8def req-cdf5d45f-7639-4585-8b08-f21717b8c3ef service nova] [instance: d3ee0b38-49cf-4df6-bbca-0a74262555d4] Received event network-vif-deleted-892b5c2d-541e-4218-898c-ba9f665cb8a5 {{(pid=74582) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 14:40:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:40:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:40:23 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:40:28 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:40:30 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:32 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:33 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:33 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:34 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:34 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74582) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 14:40:38 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:38 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:43 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Starting heal instance info cache {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Rebuilding the list of instances to heal {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.manager [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Didn't find any instances for network info cache update. {{(pid=74582) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_service.periodic_task [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74582) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74582) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 14:40:45 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:40:45 user nova-compute[74582]: WARNING nova.virt.libvirt.driver [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Hypervisor/Node resource view: name=user free_ram=9148MB free_disk=25.038158416748047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74582) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74582) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 14:40:45 user nova-compute[74582]: DEBUG nova.compute.provider_tree [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed in ProviderTree for provider: baed4ae8-b8da-4af7-979b-b6805c6b4e5e {{(pid=74582) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 14:40:46 user nova-compute[74582]: DEBUG nova.scheduler.client.report [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Inventory has not changed for provider baed4ae8-b8da-4af7-979b-b6805c6b4e5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74582) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 14:40:46 user nova-compute[74582]: DEBUG nova.compute.resource_tracker [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Compute_service record updated for user:user {{(pid=74582) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 14:40:46 user nova-compute[74582]: DEBUG oslo_concurrency.lockutils [None req-9aa66fab-e9af-473b-a7c6-ed79aa8fcaf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=74582) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 14:40:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:48 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:50 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:53 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:40:58 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:41:03 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:41:08 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:41:13 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 14:41:18 user nova-compute[74582]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74582) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}